Apr 27 15:01:37 devstack cinder-volume[71886]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 27 15:01:37 devstack cinder-volume[71886]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 27 15:01:37 devstack cinder-volume[71886]: we strongly recommend against using it for new projects.
Apr 27 15:01:37 devstack cinder-volume[71886]: If you are already using Eventlet, we recommend migrating to a different
Apr 27 15:01:37 devstack cinder-volume[71886]: framework.  For more detail see
Apr 27 15:01:37 devstack cinder-volume[71886]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 27 15:01:37 devstack cinder-volume[71886]:   import eventlet  # noqa
Apr 27 15:01:39 devstack cinder-volume[71886]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=71886) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 27 15:01:39 devstack cinder-volume[71886]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=71886) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 27 15:01:39 devstack cinder-volume[71886]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=71886) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 27 15:01:39 devstack cinder-volume[71886]: INFO dbcounter [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Registered counter for database cinder
Apr 27 15:01:39 devstack cinder-volume[71886]: DEBUG oslo_db.sqlalchemy.engines [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71886) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG dbcounter [-] [71886] Writer thread running {{(pid=71886) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 27 15:01:40 devstack cinder-volume[71886]: INFO cinder.rpc [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 27 15:01:40 devstack cinder-volume[71886]: INFO cinder.rpc [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_db.sqlalchemy.engines [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71886) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 27 15:01:40 devstack cinder-volume[71886]: INFO cinder.volume.manager [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Determined volume DB was empty at startup.
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG cinder.volume.manager [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Cinder Volume DB check: vol_db_empty=True {{(pid=71886) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 27 15:01:40 devstack cinder-volume[71886]: INFO cinder.volume.manager [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 27 15:01:40 devstack cinder-volume[71886]: WARNING stevedore.named [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 27 15:01:40 devstack cinder-volume[71886]: WARNING castellan.key_manager [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 27 15:01:40 devstack cinder-volume[71886]: WARNING cinder.keymgr.conf_key_mgr [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG cinder.volume.drivers.lvm [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=71886) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_concurrency.processutils [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=71886) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_concurrency.processutils [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] CMD "cinder-rtstool verify" returned: 0 in 0.289s {{(pid=71886) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_db.sqlalchemy.engines [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71886) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 27 15:01:40 devstack cinder-volume[71886]: INFO cinder.rpc [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 27 15:01:40 devstack cinder-volume[71886]: INFO cinder.rpc [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 27 15:01:40 devstack cinder-volume[71886]: WARNING stevedore.named [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 27 15:01:40 devstack cinder-volume[71886]: WARNING castellan.key_manager [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 27 15:01:40 devstack cinder-volume[71886]: INFO cinder.volume.manager [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_db.sqlalchemy.engines [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71886) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 27 15:01:40 devstack cinder-volume[71886]: INFO oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Starting 1 workers
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Started child 71999 {{(pid=71886) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Full set of CONF: {{(pid=71886) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] ******************************************************************************** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Configuration options gathered from: {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] ================================================================================ {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] allow_availability_zone_fallback = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] allow_compression_on_image_upload = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] allowed_direct_url_schemes     = [] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] api_rate_limit                 = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] auth_strategy                  = keystone {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] az_cache_duration              = 3600 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_availability_zone      = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_host                   = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_name                   = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_stats_polling_interval = 60 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backup_api_class               = cinder.backup.api.API {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backup_name_template           = backup-%s {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backup_use_same_host           = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backup_use_temp_snapshot       = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] chap_password                  = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] chap_username                  =  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cinder_internal_tenant_project_id = d268c45ca89b41f18b40ac392d4efdd2 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cinder_internal_tenant_user_id = 37fa1bc7b9994ff29cbda8d246eb134a {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cloned_volume_same_az          = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cluster                        = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] compression_format             = gzip {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] compute_api_class              = cinder.compute.nova.API {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] config_dir                     = [] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] config_source                  = [] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] control_exchange               = openstack {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] debug                          = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] default_availability_zone      = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] default_group_type             = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] default_volume_type            = lvmdriver-1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] disk_geometry                  = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] driver_client_cert             = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] driver_client_cert_key         = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] driver_data_namespace          = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] driver_ssl_cert_path           = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] driver_ssl_cert_verify         = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] driver_use_ssl                 = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] enable_force_upload            = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] enable_new_services            = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] enable_unsupported_driver      = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] enabled_backends               = ['lvmdriver-1'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] enforce_multipath_for_image_xfer = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] filter_function                = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance_api_insecure            = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance_api_servers             = ['http://192.168.122.133/image'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance_api_ssl_compression     = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance_ca_certificates_file    = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance_catalog_info            = image:glance:publicURL {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance_certfile                = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71999]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance_keyfile                 = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance_num_retries             = 3 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance_request_timeout         = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] goodness_function              = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] graceful_shutdown_timeout      = 5 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] group_api_class                = cinder.group.api.API {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] host                           = devstack {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] image_compress_on_upload       = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] image_conversion_address_space_limit = 1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] image_conversion_cpu_limit     = 60 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] image_conversion_disable       = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] image_upload_use_cinder_backend = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] image_upload_use_internal_tenant = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] image_volume_cache_enabled     = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] image_volume_cache_max_count   = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] image_volume_cache_max_size_gb = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] init_host_max_objects_retrieval = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] instance_format                = [instance: %(uuid)s]  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] iscsi_target_flags             =  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] iscsi_write_cache              = on {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] iser_helper                    = tgtadm {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] iser_ip_address                = 192.168.122.133 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] iser_port                      = 3260 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] log_color                      = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] log_config_append              = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] log_dir                        = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] log_file                       = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] log_options                    = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] log_rotate_interval            = 1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] log_rotate_interval_type       = days {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] log_rotation_type              = none {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] max_age                        = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] max_logfile_count              = 30 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] max_logfile_size_mb            = 200 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] max_over_subscription_ratio    = 20.0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] message_reap_interval          = 86400 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] message_ttl                    = 2592000 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] migration_create_volume_timeout_secs = 300 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] monkey_patch                   = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] monkey_patch_modules           = [] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] my_ip                          = 192.168.122.133 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] no_snapshot_gb_quota           = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] num_iser_scan_tries            = 3 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] num_shell_tries                = 3 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] num_volume_device_scan_tries   = 3 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] nvmeof_conn_info_version       = 1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] nvmet_ns_id                    = 10 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] nvmet_port_id                  = 1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] osapi_max_limit                = 1000 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] osapi_volume_ext_list          = [] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] osapi_volume_listen            = 0.0.0.0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] osapi_volume_listen_port       = 8776 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] osapi_volume_use_ssl           = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] osapi_volume_workers           = 2 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] per_volume_size_limit          = -1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] periodic_fuzzy_delay           = 60 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] periodic_interval              = 60 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] project_id_regex               = [0-9a-f\-]+ {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] public_endpoint                = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] publish_errors                 = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] quota_backup_gigabytes         = 1000 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] quota_backups                  = 10 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] quota_gigabytes                = 1000 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] quota_groups                   = 10 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] quota_snapshots                = 10 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] quota_volumes                  = 10 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] rate_limit_burst               = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] rate_limit_except_level        = CRITICAL {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] rate_limit_interval            = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] reinit_driver_count            = 3 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] replication_device             = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] report_discard_supported       = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] report_interval                = 120 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] reservation_clean_interval     = 86400 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] reservation_expire             = 86400 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] reserved_image_namespaces      = [] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] reserved_percentage            = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] rpc_response_timeout           = 120 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] run_external_periodic_tasks    = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] scst_target_driver             = iscsi {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] scst_target_iqn_name           = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] service_down_time              = 720 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] shell_completion               = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] snapshot_name_template         = snapshot-%s {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] snapshot_same_host             = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] split_loggers                  = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] state_path                     = /opt/stack/data/cinder {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] storage_availability_zone      = nova {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] storage_protocol               = iSCSI {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] syslog_log_facility            = LOG_USER {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] target_helper                  = lioadm {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] target_ip_address              = 192.168.122.133 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] target_port                    = 3260 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] target_protocol                = iscsi {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] target_secondary_ip_addresses  = [] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] trace_flags                    = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] transfer_api_class             = cinder.transfer.api.API {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] transport_url                  = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] until_refresh                  = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] use_chap_auth                  = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] use_default_quota_class        = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] use_journal                    = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] use_json                       = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] use_multipath_for_image_xfer   = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] use_stderr                     = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] use_syslog                     = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] verify_glance_signatures       = enabled {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] volume_api_class               = cinder.volume.api.API {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] volume_backend_name            = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] volume_clear                   = zero {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] volume_clear_ionice            = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] volume_clear_size              = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] volume_copy_bps_limit          = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] volume_dd_blocksize            = 1M {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] volume_name_template           = volume-%s {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] volume_service_inithost_offload = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] volume_usage_audit_period      = month {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] zoning_mode                    = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] os_brick.lightos_discovery_client_address = localhost {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] os_brick.wait_mpath_device_interval = 1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_concurrency.disable_process_locking = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.admin_password = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.admin_tenant_name = admin {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.admin_token = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.admin_user  = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.auth_admin_prefix =  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.auth_port   = 35357 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.auth_protocol = https {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.auth_section = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.auth_type   = password {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.auth_uri    = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.auth_version = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.cache       = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.certfile    = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.delay_auth_decision = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.http_connect_timeout = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.identity_uri = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.include_service_catalog = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.insecure    = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.interface   = public {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.keyfile     = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_password =  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_secret_key = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_security_strategy = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcache_username =  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.region_name = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.service_token_roles_required = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.service_type = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.token_cache_time = 300 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.133/identity {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.backend                  = dogpile.cache.null {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.backend_argument         = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.backend_expiration_time  = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.config_prefix            = cache.oslo {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.debug_cache_backend      = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.enable_retry_client      = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.enable_socket_keepalive  = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.enabled                  = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.enforce_fips_mode        = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.expiration_time          = 600 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.hashclient_retry_attempts = 2 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.hashclient_retry_timeout = 1.0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.memcache_dead_retry      = 300 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.memcache_pool_maxsize    = 10 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.memcache_sasl_enabled    = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.password                 = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.proxies                  = [] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.redis_db                 = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.redis_sentinel_service_name = mymaster {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.redis_server             = localhost:6379 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.retry_attempts           = 2 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.retry_delay              = 0.0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.socket_keepalive_count   = 1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.socket_keepalive_idle    = 1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.socket_keepalive_interval = 1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.socket_timeout           = 1.0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.tls_allowed_ciphers      = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.tls_cafile               = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.tls_certfile             = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.tls_enabled              = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71999]: INFO cinder.volume.manager [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 27 15:01:40 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.tls_keyfile              = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cache.username                 = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] coordination.backend_url       = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.asyncio_connection    = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.asyncio_slave_connection = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.backend               = sqlalchemy {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.connection            = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.connection_debug      = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.connection_parameters =  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.connection_recycle_time = 3600 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.connection_trace      = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.db_inc_retry_interval = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.db_max_retries        = 20 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.db_max_retry_interval = 10 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.db_retry_interval     = 1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.max_overflow          = 50 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.max_pool_size         = 5 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.max_retries           = 10 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.mysql_wsrep_sync_wait = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.pool_timeout          = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.retry_interval        = 10 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.slave_connection      = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.sqlite_synchronous    = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.synchronous_reader    = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] database.use_db_reconnect      = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] profiler.connection_string     = messaging:// {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] profiler.enabled               = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] profiler.es_doc_type           = notification {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] profiler.es_scroll_size        = 10000 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] profiler.es_scroll_time        = 2m {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] profiler.filter_error_trace    = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] profiler.hmac_keys             = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] profiler.sentinel_service_name = mymaster {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] profiler.socket_timeout        = 0.1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] profiler.trace_requests        = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] profiler.trace_sqlalchemy      = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] profiler_jaeger.process_tags   = {} {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] profiler_jaeger.service_name_prefix = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] profiler_otlp.service_name_prefix = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_policy.enforce_new_defaults = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: WARNING oslo_config.cfg [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_policy.enforce_scope      = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_policy.policy_default_rule = default {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_policy.policy_file        = policy.yaml {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_policy.remote_timeout     = 60.0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] privsep_osbrick.group          = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] privsep_osbrick.helper_command = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] privsep_osbrick.log_daemon_traceback = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] privsep_osbrick.thread_pool_size = 4 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] privsep_osbrick.user           = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cinder_sys_admin.group         = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cinder_sys_admin.helper_command = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] cinder_sys_admin.user          = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] service_user.auth_section      = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] service_user.auth_type         = password {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] service_user.cafile            = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] service_user.certfile          = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] service_user.collect_timing    = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] service_user.insecure          = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] service_user.keyfile           = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] service_user.send_service_user_token = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] service_user.split_loggers     = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] service_user.timeout           = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance.auth_section            = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance.auth_type               = password {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance.certfile                = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance.collect_timing          = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance.insecure                = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance.keyfile                 = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance.region_name             = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance.split_loggers           = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] glance.timeout                 = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.backend_availability_zone = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.chap_password = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.chap_username =  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.disk_geometry = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.driver_client_cert = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.driver_client_cert_key = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.driver_data_namespace = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.driver_ssl_cert_path = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.driver_use_ssl = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.enable_unsupported_driver = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.extra_capabilities = {} {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.filter_function = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.goodness_function = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.image_volume_cache_enabled = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.iscsi_target_flags =  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.iscsi_write_cache = on {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.iser_helper   = tgtadm {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.iser_ip_address = 192.168.122.133 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.iser_port     = 3260 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.lvm_mirrors   = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.lvm_share_target = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.lvm_type      = auto {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.num_shell_tries = 3 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.nvmet_port_id = 1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.replication_device = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.report_discard_supported = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.reserved_percentage = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.scst_target_driver = iscsi {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.scst_target_iqn_name = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.storage_protocol = iSCSI {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.target_helper = tgtadm {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.target_ip_address = 192.168.122.133 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.target_port   = 3260 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.target_protocol = iscsi {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.trace_flags   = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.unique_fqdn_network = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.use_chap_auth = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.volume_backend_name = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.volume_clear  = zero {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.volume_clear_ionice = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.volume_clear_size = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.volume_group  = cinder-volumes {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_reports.file_event_handler = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_reports.log_dir           = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.backend_availability_zone = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.backend_host       = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.chap_password      = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.chap_username      = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.chiscsi_conf       = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.disk_geometry      = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.driver_client_cert = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.driver_client_cert_key = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.driver_data_namespace = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.driver_use_ssl     = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.extra_capabilities = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.filter_function    = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.goodness_function  = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.iscsi_target_flags = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.iser_helper        = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.iser_ip_address    = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.iser_port          = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.iser_target_prefix = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.lvm_conf_file      = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.lvm_mirrors        = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.lvm_share_target   = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.lvm_type           = auto {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack sudo[72003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 27 15:01:40 devstack sudo[72003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.num_shell_tries    = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.nvmet_port_id      = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.replication_device = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.report_discard_supported = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.reserved_percentage = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.scst_target_driver = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.storage_protocol   = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.target_helper      = lioadm {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.target_ip_address  = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.target_port        = 3260 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.target_protocol    = iscsi {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.trace_flags        = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.unique_fqdn_network = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.use_chap_auth      = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.volume_clear       = zero {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.volume_clear_ionice = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.volume_clear_size  = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] lvmdriver-1.volumes_dir        = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.hostname = devstack {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.ssl      = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_notifications.driver = [] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_notifications.retry = -1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] oslo_messaging_notifications.transport_url = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] key_manager.fixed_key          = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.barbican_api_version  = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.barbican_endpoint     = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.barbican_endpoint_type = public {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.barbican_region_name  = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.cafile                = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.certfile              = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.collect_timing        = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.insecure              = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.keyfile               = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.number_of_retries     = 60 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.retry_delay           = 1 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.send_service_user_token = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.split_loggers         = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.timeout               = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.verify_ssl            = True {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican.verify_ssl_path       = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican_service_user.auth_section = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican_service_user.auth_type = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican_service_user.cafile   = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican_service_user.certfile = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican_service_user.collect_timing = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican_service_user.insecure = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican_service_user.keyfile  = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican_service_user.split_loggers = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] barbican_service_user.timeout  = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] vault.approle_role_id          = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] vault.approle_secret_id        = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] vault.kv_mountpoint            = secret {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] vault.kv_path                  = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] vault.kv_version               = 2 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] vault.namespace                = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] vault.root_token_id            = **** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] vault.ssl_ca_crt_file          = None {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] vault.timeout                  = 60.0 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] vault.use_ssl                  = False {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:01:40 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] ******************************************************************************** {{(pid=71886) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 27 15:01:41 devstack sudo[72003]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:41 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.518s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:41 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:41 devstack sudo[72040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 27 15:01:41 devstack sudo[72040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:41 devstack sudo[72040]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:41 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.589s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:41 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:01:41 devstack cinder-volume[71999]: INFO cinder.brick.local_dev.lvm [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 27 15:01:41 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:41 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:41 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:41 devstack sudo[72288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 27 15:01:41 devstack sudo[72288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:42 devstack sudo[72288]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:42 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.521s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:42 devstack cinder-volume[71999]: DEBUG cinder.brick.local_dev.lvm [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=71999) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 27 15:01:42 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:42 devstack sudo[72479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 27 15:01:42 devstack sudo[72479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:43 devstack sudo[72479]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:43 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.171s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:43 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:43 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:43 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:43 devstack sudo[72687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 27 15:01:43 devstack sudo[72687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:44 devstack sudo[72687]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:44 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.489s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:44 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:44 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:44 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:44 devstack sudo[72691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 27 15:01:44 devstack sudo[72691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:44 devstack sudo[72691]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:44 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.460s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:44 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:44 devstack sudo[72694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 27 15:01:44 devstack sudo[72694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:45 devstack sudo[72694]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:45 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:45 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:45 devstack sudo[72702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 27 15:01:45 devstack sudo[72702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:45 devstack sudo[72702]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:45 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:45 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:45 devstack sudo[72705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 27 15:01:45 devstack sudo[72705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:46 devstack sudo[72705]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:46 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:46 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:46 devstack sudo[72710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 27 15:01:46 devstack sudo[72710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:46 devstack sudo[72710]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:46 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:46 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:46 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:46 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:46 devstack sudo[72714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 27 15:01:46 devstack sudo[72714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:46 devstack sudo[72714]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:46 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:46 devstack cinder-volume[71999]: INFO cinder.volume.drivers.lvm [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 27 15:01:46 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:46 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:46 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:46 devstack sudo[72719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 27 15:01:46 devstack sudo[72719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:47 devstack sudo[72719]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:47 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.672s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:47 devstack cinder-volume[71999]: DEBUG cinder.volume.drivers.lvm [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Updating volume stats {{(pid=71999) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 27 15:01:47 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:47 devstack sudo[72839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 27 15:01:47 devstack sudo[72839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:48 devstack sudo[72839]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:48 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:48 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:48 devstack sudo[72843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 27 15:01:48 devstack sudo[72843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:48 devstack sudo[72843]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:48 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.531s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:48 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:48 devstack sudo[72984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 27 15:01:48 devstack sudo[72984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:49 devstack sudo[72984]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:49 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.504s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:49 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:49 devstack sudo[72988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 27 15:01:49 devstack sudo[72988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:49 devstack sudo[72988]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:49 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:49 devstack cinder-volume[71999]: INFO cinder.volume.driver [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Driver hasn't implemented _init_vendor_properties()
Apr 27 15:01:49 devstack cinder-volume[71999]: DEBUG cinder.volume.driver [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=71999) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 27 15:01:49 devstack cinder-volume[71999]: DEBUG oslo_db.sqlalchemy.engines [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 27 15:01:49 devstack cinder-volume[71999]: DEBUG dbcounter [-] [71999] Writer thread running {{(pid=71999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 27 15:01:49 devstack cinder-volume[71999]: DEBUG cinder.db.sqlalchemy.api [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Building query based on filter {{(pid=71999) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 27 15:01:49 devstack cinder-volume[71999]: DEBUG cinder.image.image_utils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=71999) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 27 15:01:49 devstack cinder-volume[71999]: INFO cinder.keymgr.migration [None req-c1c3a6e7-b24d-4ea3-a2cd-085c569b4974 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 27 15:01:49 devstack cinder-volume[71999]: DEBUG cinder.volume.drivers.lvm [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Updating volume stats {{(pid=71999) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 27 15:01:49 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:49 devstack sudo[72995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 27 15:01:49 devstack sudo[72995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:50 devstack sudo[72995]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:50 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.501s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:50 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:50 devstack sudo[72998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 27 15:01:50 devstack sudo[72998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:50 devstack cinder-volume[71886]: DEBUG dbcounter [-] [71886] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=71886) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:01:50 devstack sudo[72998]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:50 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:50 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:50 devstack sudo[73003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 27 15:01:50 devstack sudo[73003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:51 devstack sudo[73003]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:51 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:51 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:51 devstack sudo[73007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 27 15:01:51 devstack sudo[73007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:51 devstack sudo[73007]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:51 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:51 devstack cinder-volume[71999]: DEBUG cinder.manager [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Notifying Schedulers of capabilities ... {{(pid=71999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:01:51 devstack cinder-volume[71999]: INFO cinder.volume.manager [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Driver initialization completed successfully.
Apr 27 15:01:51 devstack cinder-volume[71999]: INFO cinder.manager [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Initiating service 2 cleanup
Apr 27 15:01:51 devstack cinder-volume[71999]: INFO cinder.manager [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Service 2 cleanup completed.
Apr 27 15:01:51 devstack cinder-volume[71999]: DEBUG cinder.service [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Creating RPC server for service cinder-volume {{(pid=71999) start /opt/stack/cinder/cinder/service.py:231}}
Apr 27 15:01:51 devstack cinder-volume[71999]: DEBUG cinder.service [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=71999) start /opt/stack/cinder/cinder/service.py:237}}
Apr 27 15:01:51 devstack cinder-volume[71999]: INFO cinder.volume.manager [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 27 15:01:51 devstack cinder-volume[71999]: DEBUG cinder.volume.drivers.lvm [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Updating volume stats {{(pid=71999) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 27 15:01:51 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:51 devstack sudo[73014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 27 15:01:51 devstack sudo[73014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:52 devstack sudo[73014]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:52 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.522s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:52 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:52 devstack sudo[73017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 27 15:01:52 devstack sudo[73017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:52 devstack sudo[73017]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:52 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:52 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:52 devstack sudo[73021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 27 15:01:52 devstack sudo[73021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:53 devstack sudo[73021]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:53 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.579s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:53 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:01:53 devstack sudo[73058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 27 15:01:53 devstack sudo[73058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:01:53 devstack sudo[73058]: pam_unix(sudo:session): session closed for user root
Apr 27 15:01:53 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:01:53 devstack cinder-volume[71999]: INFO cinder.volume.manager [None req-574e577d-52fc-4ef8-a96f-b3f5f7d99274 None None] Driver post RPC initialization completed successfully.
Apr 27 15:02:03 devstack cinder-volume[71999]: DEBUG dbcounter [-] [71999] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=71999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:02:03 devstack cinder-volume[71999]: DEBUG dbcounter [-] [71999] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=71999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:03:15 devstack cinder-volume[71999]: DEBUG oslo_service.periodic_task [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71999) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:03:15 devstack cinder-volume[71999]: DEBUG cinder.volume.drivers.lvm [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Updating volume stats {{(pid=71999) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 27 15:03:15 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:03:15 devstack sudo[77939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 27 15:03:15 devstack sudo[77939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:03:16 devstack sudo[77939]: pam_unix(sudo:session): session closed for user root
Apr 27 15:03:16 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:03:16 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:03:16 devstack sudo[77947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 27 15:03:16 devstack sudo[77947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:03:16 devstack sudo[77947]: pam_unix(sudo:session): session closed for user root
Apr 27 15:03:16 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:03:16 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:03:16 devstack sudo[77953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 27 15:03:16 devstack sudo[77953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:03:17 devstack sudo[77953]: pam_unix(sudo:session): session closed for user root
Apr 27 15:03:17 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:03:17 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:03:17 devstack sudo[77960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 27 15:03:17 devstack sudo[77960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:03:17 devstack sudo[77960]: pam_unix(sudo:session): session closed for user root
Apr 27 15:03:17 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:03:17 devstack cinder-volume[71999]: DEBUG cinder.manager [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Notifying Schedulers of capabilities ... {{(pid=71999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:04:03 devstack cinder-volume[71999]: DEBUG dbcounter [-] [71999] Writing DB stats cinder:SELECT=1 {{(pid=71999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:04:03 devstack cinder-volume[71999]: DEBUG dbcounter [-] [71999] Writing DB stats cinder:UPDATE=1 {{(pid=71999) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:04:15 devstack cinder-volume[71999]: DEBUG oslo_service.periodic_task [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71999) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:04:15 devstack cinder-volume[71999]: DEBUG cinder.volume.drivers.lvm [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Updating volume stats {{(pid=71999) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 27 15:04:15 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:04:15 devstack sudo[79597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 27 15:04:15 devstack sudo[79597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:04:16 devstack sudo[79597]: pam_unix(sudo:session): session closed for user root
Apr 27 15:04:16 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:04:16 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:04:16 devstack sudo[79620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 27 15:04:16 devstack sudo[79620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:04:16 devstack sudo[79620]: pam_unix(sudo:session): session closed for user root
Apr 27 15:04:16 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:04:16 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:04:16 devstack sudo[79629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 27 15:04:16 devstack sudo[79629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:04:17 devstack sudo[79629]: pam_unix(sudo:session): session closed for user root
Apr 27 15:04:17 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:04:17 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:04:17 devstack sudo[79657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 27 15:04:17 devstack sudo[79657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:04:17 devstack sudo[79657]: pam_unix(sudo:session): session closed for user root
Apr 27 15:04:17 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:04:17 devstack cinder-volume[71999]: DEBUG cinder.manager [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Notifying Schedulers of capabilities ... {{(pid=71999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:05:15 devstack cinder-volume[71999]: DEBUG oslo_service.periodic_task [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71999) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:05:15 devstack cinder-volume[71999]: DEBUG cinder.volume.drivers.lvm [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Updating volume stats {{(pid=71999) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 27 15:05:15 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:05:15 devstack sudo[80721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 27 15:05:15 devstack sudo[80721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:05:16 devstack sudo[80721]: pam_unix(sudo:session): session closed for user root
Apr 27 15:05:16 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:05:16 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:05:16 devstack sudo[80766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 27 15:05:16 devstack sudo[80766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:05:16 devstack sudo[80766]: pam_unix(sudo:session): session closed for user root
Apr 27 15:05:16 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:05:16 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:05:16 devstack sudo[80798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 27 15:05:16 devstack sudo[80798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:05:17 devstack sudo[80798]: pam_unix(sudo:session): session closed for user root
Apr 27 15:05:17 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:05:17 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:05:17 devstack sudo[80833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 27 15:05:17 devstack sudo[80833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:05:17 devstack sudo[80833]: pam_unix(sudo:session): session closed for user root
Apr 27 15:05:17 devstack cinder-volume[71999]: DEBUG oslo_concurrency.processutils [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=71999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:05:17 devstack cinder-volume[71999]: DEBUG cinder.manager [None req-35c12240-4bf9-4541-989a-52b1136c138c None None] Notifying Schedulers of capabilities ... {{(pid=71999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:05:19 devstack cinder-volume[71886]: INFO oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Caught SIGTERM, stopping children
Apr 27 15:05:19 devstack cinder-volume[71886]: DEBUG oslo_concurrency.lockutils [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Acquiring lock "singleton_lock" {{(pid=71886) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 27 15:05:19 devstack cinder-volume[71886]: DEBUG oslo_concurrency.lockutils [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Acquired lock "singleton_lock" {{(pid=71886) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 27 15:05:19 devstack cinder-volume[71886]: DEBUG oslo_concurrency.lockutils [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Releasing lock "singleton_lock" {{(pid=71886) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 27 15:05:19 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Stop services. {{(pid=71886) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 27 15:05:19 devstack cinder-volume[71886]: DEBUG oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Killing children. {{(pid=71886) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 27 15:05:19 devstack cinder-volume[71886]: INFO oslo_service.backend._eventlet.service [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Waiting on 1 children to exit
Apr 27 15:05:24 devstack cinder-volume[71999]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Apr 27 15:05:24 devstack cinder-volume[80962]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 27 15:05:24 devstack cinder-volume[80962]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 27 15:05:24 devstack cinder-volume[80962]: we strongly recommend against using it for new projects.
Apr 27 15:05:24 devstack cinder-volume[80962]: If you are already using Eventlet, we recommend migrating to a different
Apr 27 15:05:24 devstack cinder-volume[80962]: framework.  For more detail see
Apr 27 15:05:24 devstack cinder-volume[80962]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 27 15:05:24 devstack cinder-volume[80962]:   import eventlet  # noqa
Apr 27 15:05:26 devstack cinder-volume[71999]: DEBUG oslo_concurrency.lockutils [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Acquiring lock "singleton_lock" {{(pid=71999) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 27 15:05:26 devstack cinder-volume[71999]: DEBUG oslo_concurrency.lockutils [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Acquired lock "singleton_lock" {{(pid=71999) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 27 15:05:26 devstack cinder-volume[71999]: DEBUG oslo_concurrency.lockutils [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Releasing lock "singleton_lock" {{(pid=71999) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 27 15:05:26 devstack cinder-volume[71999]: WARNING amqp [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 27 15:05:26 devstack cinder-volume[71999]: WARNING amqp [None req-d0ccd087-820d-4711-94dc-994e60c56dfe None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 27 15:05:26 devstack cinder-volume[80962]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80962) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 27 15:05:26 devstack cinder-volume[80962]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80962) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 27 15:05:26 devstack cinder-volume[80962]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80962) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 27 15:05:27 devstack cinder-volume[80962]: INFO dbcounter [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Registered counter for database cinder
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_db.sqlalchemy.engines [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80962) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG dbcounter [-] [80962] Writer thread running {{(pid=80962) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 27 15:05:27 devstack cinder-volume[80962]: INFO cinder.rpc [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 27 15:05:27 devstack cinder-volume[80962]: INFO cinder.rpc [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_db.sqlalchemy.engines [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80962) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 27 15:05:27 devstack cinder-volume[80962]: INFO cinder.volume.manager [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Determined volume DB was empty at startup.
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG cinder.volume.manager [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80962) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 27 15:05:27 devstack cinder-volume[80962]: INFO cinder.volume.manager [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 27 15:05:27 devstack cinder-volume[80962]: WARNING stevedore.named [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 27 15:05:27 devstack cinder-volume[80962]: WARNING castellan.key_manager [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 27 15:05:27 devstack cinder-volume[80962]: WARNING cinder.keymgr.conf_key_mgr [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 27 15:05:27 devstack cinder-volume[80962]: INFO cinder.volume.manager [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_db.sqlalchemy.engines [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80962) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 27 15:05:27 devstack cinder-volume[80962]: INFO oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Starting 1 workers
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Started child 81076 {{(pid=80962) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Full set of CONF: {{(pid=80962) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] ******************************************************************************** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Configuration options gathered from: {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] ================================================================================ {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] allow_availability_zone_fallback = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] allow_compression_on_image_upload = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] allowed_direct_url_schemes     = [] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] api_rate_limit                 = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] auth_strategy                  = keystone {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_availability_zone      = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_host                   = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_name                   = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_stats_polling_interval = 60 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backup_api_class               = cinder.backup.api.API {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backup_name_template           = backup-%s {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backup_use_same_host           = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backup_use_temp_snapshot       = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] chap_password                  = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] chap_username                  =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cinder_internal_tenant_project_id = d268c45ca89b41f18b40ac392d4efdd2 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cinder_internal_tenant_user_id = 37fa1bc7b9994ff29cbda8d246eb134a {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cluster                        = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] compression_format             = gzip {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] compute_api_class              = cinder.compute.nova.API {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] config_dir                     = [] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] config_source                  = [] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] control_exchange               = openstack {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] debug                          = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] default_availability_zone      = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] default_group_type             = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] default_volume_type            = QuobyteHD {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[81076]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] disk_geometry                  = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] driver_client_cert             = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] driver_client_cert_key         = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] driver_data_namespace          = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] driver_ssl_cert_path           = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] driver_ssl_cert_verify         = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] driver_use_ssl                 = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] enable_new_services            = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] enable_unsupported_driver      = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] enabled_backends               = ['QuobyteHD'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] enforce_multipath_for_image_xfer = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] filter_function                = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance_api_insecure            = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance_api_servers             = ['http://192.168.122.133/image'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance_api_ssl_compression     = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance_ca_certificates_file    = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance_catalog_info            = image:glance:publicURL {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance_certfile                = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance_keyfile                 = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance_num_retries             = 3 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance_request_timeout         = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] goodness_function              = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] graceful_shutdown_timeout      = 5 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] group_api_class                = cinder.group.api.API {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] host                           = devstack {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] image_compress_on_upload       = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] image_conversion_address_space_limit = 1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] image_conversion_cpu_limit     = 60 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] image_conversion_disable       = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] image_upload_use_cinder_backend = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] image_upload_use_internal_tenant = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] image_volume_cache_enabled     = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] image_volume_cache_max_count   = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] image_volume_cache_max_size_gb = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] init_host_max_objects_retrieval = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] instance_format                = [instance: %(uuid)s]  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] iscsi_target_flags             =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] iscsi_write_cache              = on {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] iser_helper                    = tgtadm {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] iser_ip_address                = 192.168.122.133 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] iser_port                      = 3260 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] log_color                      = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] log_config_append              = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] log_dir                        = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] log_file                       = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] log_options                    = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] log_rotate_interval            = 1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] log_rotate_interval_type       = days {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] log_rotation_type              = none {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] max_age                        = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] max_logfile_count              = 30 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] max_logfile_size_mb            = 200 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] max_over_subscription_ratio    = 20.0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] message_reap_interval          = 86400 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] message_ttl                    = 2592000 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] migration_create_volume_timeout_secs = 300 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] monkey_patch                   = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] monkey_patch_modules           = [] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] my_ip                          = 192.168.122.133 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] no_snapshot_gb_quota           = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] num_iser_scan_tries            = 3 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] num_shell_tries                = 3 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] num_volume_device_scan_tries   = 3 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] nvmeof_conn_info_version       = 1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] nvmet_ns_id                    = 10 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] nvmet_port_id                  = 1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] osapi_max_limit                = 1000 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] osapi_volume_ext_list          = [] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] osapi_volume_listen_port       = 8776 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] osapi_volume_use_ssl           = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] osapi_volume_workers           = 2 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] per_volume_size_limit          = -1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] periodic_fuzzy_delay           = 60 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] periodic_interval              = 60 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] public_endpoint                = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] publish_errors                 = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] quota_backup_gigabytes         = 1000 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] quota_backups                  = 10 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] quota_gigabytes                = 1000 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] quota_groups                   = 10 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] quota_snapshots                = 10 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] quota_volumes                  = 10 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] rate_limit_burst               = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] rate_limit_except_level        = CRITICAL {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] rate_limit_interval            = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] reinit_driver_count            = 3 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] replication_device             = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] report_discard_supported       = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] report_interval                = 120 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] reservation_clean_interval     = 86400 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] reservation_expire             = 86400 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] reserved_image_namespaces      = [] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] reserved_percentage            = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] rpc_response_timeout           = 120 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] run_external_periodic_tasks    = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] scst_target_driver             = iscsi {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] scst_target_iqn_name           = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] service_down_time              = 720 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] shell_completion               = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] snapshot_name_template         = snapshot-%s {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] split_loggers                  = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] state_path                     = /opt/stack/data/cinder {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] storage_availability_zone      = nova {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] storage_protocol               = iSCSI {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] syslog_log_facility            = LOG_USER {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] target_helper                  = lioadm {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] target_ip_address              = 192.168.122.133 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] target_port                    = 3260 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[81076]: INFO cinder.volume.manager [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] target_protocol                = iscsi {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[81076]: DEBUG cinder.volume.drivers.remotefs [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81076) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] target_secondary_ip_addresses  = [] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] trace_flags                    = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] transport_url                  = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] until_refresh                  = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] use_chap_auth                  = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] use_default_quota_class        = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] use_journal                    = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] use_json                       = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] use_multipath_for_image_xfer   = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] use_stderr                     = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] use_syslog                     = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] verify_glance_signatures       = enabled {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] volume_api_class               = cinder.volume.api.API {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] volume_backend_name            = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] volume_clear                   = zero {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] volume_clear_ionice            = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] volume_clear_size              = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] volume_copy_bps_limit          = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] volume_dd_blocksize            = 1M {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] volume_name_template           = volume-%s {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] volume_service_inithost_offload = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] volume_usage_audit_period      = month {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] zoning_mode                    = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_concurrency.disable_process_locking = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.admin_password = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.admin_token = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.admin_user  = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:27 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.auth_port   = 35357 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.auth_protocol = https {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.auth_section = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.auth_type   = password {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.auth_uri    = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.auth_version = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.cache       = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.certfile    = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.delay_auth_decision = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.http_connect_timeout = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.identity_uri = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.include_service_catalog = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.insecure    = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.interface   = public {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.keyfile     = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_password =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcache_username =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.region_name = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.service_token_roles_required = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.service_type = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.token_cache_time = 300 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.133/identity {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.backend                  = dogpile.cache.null {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.backend_argument         = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.backend_expiration_time  = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.config_prefix            = cache.oslo {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.debug_cache_backend      = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.enable_retry_client      = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.enable_socket_keepalive  = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.enabled                  = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.enforce_fips_mode        = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.expiration_time          = 600 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.hashclient_retry_attempts = 2 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.memcache_dead_retry      = 300 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.memcache_pool_maxsize    = 10 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.memcache_sasl_enabled    = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.password                 = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.proxies                  = [] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.redis_db                 = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.redis_sentinel_service_name = mymaster {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.redis_server             = localhost:6379 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.retry_attempts           = 2 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.retry_delay              = 0.0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.socket_keepalive_count   = 1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.socket_keepalive_idle    = 1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.socket_keepalive_interval = 1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.socket_timeout           = 1.0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.tls_allowed_ciphers      = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.tls_cafile               = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.tls_certfile             = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.tls_enabled              = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.tls_keyfile              = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cache.username                 = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] coordination.backend_url       = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.asyncio_connection    = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.asyncio_slave_connection = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.backend               = sqlalchemy {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.connection            = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.connection_debug      = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.connection_parameters =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.connection_recycle_time = 3600 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.connection_trace      = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.db_inc_retry_interval = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.db_max_retries        = 20 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.db_max_retry_interval = 10 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[81076]: DEBUG cinder.volume.drivers.quobyte [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81076) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 27 15:05:28 devstack cinder-volume[81076]: WARNING cinder.volume.drivers.quobyte [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 27 15:05:28 devstack cinder-volume[81076]: WARNING cinder.volume.drivers.quobyte [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 27 15:05:28 devstack cinder-volume[81076]: DEBUG oslo_concurrency.processutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Running cmd (subprocess): mount.quobyte {{(pid=81076) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.db_retry_interval     = 1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.max_overflow          = 50 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.max_pool_size         = 5 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.max_retries           = 10 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.mysql_wsrep_sync_wait = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.pool_timeout          = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.retry_interval        = 10 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.slave_connection      = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.sqlite_synchronous    = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.synchronous_reader    = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] database.use_db_reconnect      = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] profiler.connection_string     = messaging:// {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] profiler.enabled               = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] profiler.es_doc_type           = notification {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] profiler.es_scroll_size        = 10000 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] profiler.es_scroll_time        = 2m {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] profiler.filter_error_trace    = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] profiler.hmac_keys             = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] profiler.sentinel_service_name = mymaster {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] profiler.socket_timeout        = 0.1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] profiler.trace_requests        = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] profiler.trace_sqlalchemy      = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] profiler_jaeger.process_tags   = {} {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] profiler_jaeger.service_name_prefix = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] profiler_otlp.service_name_prefix = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_policy.enforce_new_defaults = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: WARNING oslo_config.cfg [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_policy.enforce_scope      = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_policy.policy_default_rule = default {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_policy.policy_file        = policy.yaml {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] privsep_osbrick.group          = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] privsep_osbrick.helper_command = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] privsep_osbrick.user           = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cinder_sys_admin.group         = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cinder_sys_admin.helper_command = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] cinder_sys_admin.user          = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] service_user.auth_section      = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] service_user.auth_type         = password {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] service_user.cafile            = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] service_user.certfile          = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] service_user.collect_timing    = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] service_user.insecure          = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] service_user.keyfile           = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] service_user.send_service_user_token = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] service_user.split_loggers     = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] service_user.timeout           = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance.auth_section            = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance.auth_type               = password {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance.certfile                = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance.collect_timing          = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance.insecure                = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance.keyfile                 = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance.region_name             = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance.split_loggers           = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] glance.timeout                 = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.backend_availability_zone = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.chap_password = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.chap_username =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.disk_geometry = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.driver_client_cert = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.driver_client_cert_key = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.driver_data_namespace = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.driver_use_ssl = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.enable_unsupported_driver = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.extra_capabilities = {} {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.filter_function = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.goodness_function = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.iscsi_target_flags =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.iscsi_write_cache = on {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.iser_helper   = tgtadm {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.iser_ip_address = 192.168.122.133 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.iser_port     = 3260 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.nas_host      =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.nas_login     = admin {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.nas_mount_options = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.nas_password  = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.nas_private_key =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.nas_share_path =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.num_shell_tries = 3 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack quobyte-client[81083]: Reading configuration file: /etc/quobyte/client.cfg
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.nvmet_port_id = 1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.quobyte_client_cfg = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack quobyte-client[81083]: Invalid parameters found, error: missing mount point.
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.quobyte_volume_url = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.replication_device = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.report_discard_supported = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack quobyte-client[81083]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 27 15:05:28 devstack quobyte-client[81083]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.reserved_percentage = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[81076]: DEBUG oslo_concurrency.processutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=81076) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:05:28 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81076) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:05:28 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81076) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:05:28 devstack cinder-volume[81076]: DEBUG cinder.volume.drivers.quobyte [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81076) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:05:28 devstack cinder-volume[81076]: INFO cinder.volume.drivers.quobyte [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c ...
Apr 27 15:05:28 devstack cinder-volume[81076]: DEBUG oslo_concurrency.processutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 -c /etc/quobyte/client-cinder.cfg {{(pid=81076) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.scst_target_driver = iscsi {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.scst_target_iqn_name = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.storage_protocol = iSCSI {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.target_helper = tgtadm {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.target_ip_address = 192.168.122.133 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.target_port   = 3260 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.target_protocol = iscsi {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.trace_flags   = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.unique_fqdn_network = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.use_chap_auth = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.volume_backend_name = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.volume_clear  = zero {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.volume_clear_ionice = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.volume_clear_size = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_reports.file_event_handler = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_reports.log_dir           = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.backend_availability_zone = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.backend_host         = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.chap_password        = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.chap_username        = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.chiscsi_conf         = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.disk_geometry        = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.driver_client_cert   = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.driver_client_cert_key = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.driver_data_namespace = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.driver_use_ssl       = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.extra_capabilities   = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.filter_function      = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.goodness_function    = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.iser_helper          = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.iser_ip_address      = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.iser_port            = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.iser_target_prefix   = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.nas_host             = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.nas_login            = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.nas_mount_options    = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.nas_password         = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.nas_private_key      = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.nas_share_path       = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.nas_ssh_port         = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.num_shell_tries      = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.nvmet_port_id        = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.replication_device   = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.report_discard_supported = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.reserved_percentage  = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.scst_target_driver   = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.storage_protocol     = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.target_helper        = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.target_ip_address    = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.target_port          = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.target_prefix        = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.target_protocol      = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.trace_flags          = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.use_chap_auth        = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.volume_clear         = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.volume_clear_size    = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] QuobyteHD.volumes_dir          = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.ssl      = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_notifications.driver = [] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_notifications.retry = -1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] oslo_messaging_notifications.transport_url = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] key_manager.fixed_key          = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.barbican_api_version  = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.barbican_endpoint     = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.barbican_endpoint_type = public {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack sudo[81085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 -c /etc/quobyte/client-cinder.cfg
Apr 27 15:05:28 devstack sudo[81085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.barbican_region_name  = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.cafile                = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.certfile              = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.collect_timing        = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.insecure              = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.keyfile               = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.number_of_retries     = 60 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.retry_delay           = 1 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.send_service_user_token = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.split_loggers         = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.timeout               = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.verify_ssl            = True {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican.verify_ssl_path       = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican_service_user.auth_section = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican_service_user.auth_type = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican_service_user.cafile   = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican_service_user.certfile = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican_service_user.collect_timing = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican_service_user.insecure = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican_service_user.keyfile  = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican_service_user.split_loggers = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] barbican_service_user.timeout  = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] vault.approle_role_id          = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] vault.approle_secret_id        = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] vault.kv_mountpoint            = secret {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] vault.kv_path                  = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] vault.kv_version               = 2 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] vault.namespace                = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] vault.root_token_id            = **** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] vault.ssl_ca_crt_file          = None {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] vault.timeout                  = 60.0 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] vault.use_ssl                  = False {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:28 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] ******************************************************************************** {{(pid=80962) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 27 15:05:28 devstack sudo[81085]: pam_unix(sudo:session): session closed for user root
Apr 27 15:05:28 devstack cinder-volume[81076]: DEBUG oslo_concurrency.processutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.586s {{(pid=81076) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:05:28 devstack cinder-volume[81076]: INFO cinder.volume.drivers.quobyte [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c succeeded
Apr 27 15:05:28 devstack cinder-volume[81076]: DEBUG cinder.volume.drivers.quobyte [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81076) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:05:28 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.595s {{(pid=81076) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:05:28 devstack cinder-volume[81076]: DEBUG oslo_concurrency.processutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81076) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:05:28 devstack sudo[81157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:05:28 devstack sudo[81157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:05:29 devstack sudo[81157]: pam_unix(sudo:session): session closed for user root
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG oslo_concurrency.processutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.418s {{(pid=81076) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:05:29 devstack cinder-volume[81076]: INFO cinder.volume.driver [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Driver hasn't implemented _init_vendor_properties()
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG cinder.volume.driver [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327613830566, 'free_capacity_gb': 1775.7327613830566, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81076) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG oslo_db.sqlalchemy.engines [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81076) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG dbcounter [-] [81076] Writer thread running {{(pid=81076) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG cinder.db.sqlalchemy.api [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Building query based on filter {{(pid=81076) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG cinder.image.image_utils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81076) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 27 15:05:29 devstack cinder-volume[81076]: INFO cinder.keymgr.migration [None req-ab184912-1c07-4266-a756-868e482fa0ec None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81076) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81076) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG cinder.volume.drivers.quobyte [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81076) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG cinder.volume.drivers.quobyte [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81076) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81076) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG oslo_concurrency.processutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81076) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:05:29 devstack sudo[81160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:05:29 devstack sudo[81160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:05:29 devstack sudo[81160]: pam_unix(sudo:session): session closed for user root
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG oslo_concurrency.processutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.387s {{(pid=81076) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG cinder.manager [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Notifying Schedulers of capabilities ... {{(pid=81076) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:05:29 devstack cinder-volume[81076]: INFO cinder.volume.manager [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Driver initialization completed successfully.
Apr 27 15:05:29 devstack cinder-volume[81076]: INFO cinder.manager [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Initiating service 3 cleanup
Apr 27 15:05:29 devstack cinder-volume[81076]: INFO cinder.manager [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Service 3 cleanup completed.
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG cinder.service [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Creating RPC server for service cinder-volume {{(pid=81076) start /opt/stack/cinder/cinder/service.py:231}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG cinder.service [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81076) start /opt/stack/cinder/cinder/service.py:237}}
Apr 27 15:05:29 devstack cinder-volume[81076]: INFO cinder.volume.manager [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81076) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81076) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG cinder.volume.drivers.quobyte [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81076) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG cinder.volume.drivers.quobyte [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81076) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81076) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:05:29 devstack cinder-volume[81076]: DEBUG oslo_concurrency.processutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81076) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:05:29 devstack sudo[81165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:05:29 devstack sudo[81165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:05:30 devstack sudo[81165]: pam_unix(sudo:session): session closed for user root
Apr 27 15:05:30 devstack cinder-volume[81076]: DEBUG oslo_concurrency.processutils [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.415s {{(pid=81076) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:05:30 devstack cinder-volume[81076]: INFO cinder.volume.manager [None req-35a3c31d-84cb-4142-bc7c-63cc7f717595 None None] Driver post RPC initialization completed successfully.
Apr 27 15:05:33 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-6059a56a-5752-41ef-82f4-dd0d14f91ddb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81076) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:05:33 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-6059a56a-5752-41ef-82f4-dd0d14f91ddb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81076) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:05:33 devstack cinder-volume[81076]: DEBUG cinder.volume.drivers.quobyte [None req-6059a56a-5752-41ef-82f4-dd0d14f91ddb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81076) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:05:33 devstack cinder-volume[81076]: DEBUG cinder.volume.drivers.quobyte [None req-6059a56a-5752-41ef-82f4-dd0d14f91ddb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81076) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:05:33 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-6059a56a-5752-41ef-82f4-dd0d14f91ddb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81076) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:05:33 devstack cinder-volume[81076]: DEBUG oslo_concurrency.processutils [None req-6059a56a-5752-41ef-82f4-dd0d14f91ddb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81076) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:05:33 devstack sudo[81246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:05:33 devstack sudo[81246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:05:33 devstack sudo[81246]: pam_unix(sudo:session): session closed for user root
Apr 27 15:05:33 devstack cinder-volume[81076]: DEBUG oslo_concurrency.processutils [None req-6059a56a-5752-41ef-82f4-dd0d14f91ddb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.403s {{(pid=81076) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:05:33 devstack cinder-volume[81076]: DEBUG cinder.manager [None req-6059a56a-5752-41ef-82f4-dd0d14f91ddb None None] Notifying Schedulers of capabilities ... {{(pid=81076) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:05:34 devstack cinder-volume[80962]: INFO oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Caught SIGTERM, stopping children
Apr 27 15:05:34 devstack cinder-volume[80962]: DEBUG oslo_concurrency.lockutils [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Acquiring lock "singleton_lock" {{(pid=80962) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 27 15:05:34 devstack cinder-volume[80962]: DEBUG oslo_concurrency.lockutils [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Acquired lock "singleton_lock" {{(pid=80962) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 27 15:05:34 devstack cinder-volume[80962]: DEBUG oslo_concurrency.lockutils [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Releasing lock "singleton_lock" {{(pid=80962) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 27 15:05:34 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Stop services. {{(pid=80962) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 27 15:05:34 devstack cinder-volume[80962]: DEBUG oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Killing children. {{(pid=80962) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 27 15:05:34 devstack cinder-volume[80962]: INFO oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Waiting on 1 children to exit
Apr 27 15:05:37 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Acquiring lock "singleton_lock" {{(pid=81076) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 27 15:05:37 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Acquired lock "singleton_lock" {{(pid=81076) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 27 15:05:37 devstack cinder-volume[81076]: DEBUG oslo_concurrency.lockutils [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Releasing lock "singleton_lock" {{(pid=81076) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 27 15:05:37 devstack cinder-volume[81076]: WARNING amqp [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 27 15:05:37 devstack cinder-volume[81076]: WARNING amqp [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 27 15:05:37 devstack cinder-volume[80962]: INFO oslo_service.backend._eventlet.service [None req-182cc0aa-b948-4ed2-a7c3-a7f1e755e32b None None] Child 81076 exited with status 0
Apr 27 15:05:38 devstack cinder-volume[81326]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 27 15:05:38 devstack cinder-volume[81326]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 27 15:05:38 devstack cinder-volume[81326]: we strongly recommend against using it for new projects.
Apr 27 15:05:38 devstack cinder-volume[81326]: If you are already using Eventlet, we recommend migrating to a different
Apr 27 15:05:38 devstack cinder-volume[81326]: framework.  For more detail see
Apr 27 15:05:38 devstack cinder-volume[81326]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 27 15:05:38 devstack cinder-volume[81326]:   import eventlet  # noqa
Apr 27 15:05:40 devstack cinder-volume[81326]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 27 15:05:40 devstack cinder-volume[81326]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 27 15:05:40 devstack cinder-volume[81326]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 27 15:05:40 devstack cinder-volume[81326]: INFO dbcounter [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] Registered counter for database cinder
Apr 27 15:05:40 devstack cinder-volume[81326]: DEBUG oslo_db.sqlalchemy.engines [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81326) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 27 15:05:40 devstack cinder-volume[81326]: DEBUG dbcounter [-] [81326] Writer thread running {{(pid=81326) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 27 15:05:40 devstack cinder-volume[81326]: INFO cinder.rpc [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 27 15:05:40 devstack cinder-volume[81326]: INFO cinder.rpc [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 27 15:05:40 devstack cinder-volume[81326]: DEBUG oslo_db.sqlalchemy.engines [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81326) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 27 15:05:41 devstack cinder-volume[81326]: INFO cinder.volume.manager [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] Determined volume DB was empty at startup.
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG cinder.volume.manager [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81326) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 27 15:05:41 devstack cinder-volume[81326]: WARNING stevedore.named [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 27 15:05:41 devstack cinder-volume[81326]: WARNING castellan.key_manager [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 27 15:05:41 devstack cinder-volume[81326]: WARNING cinder.keymgr.conf_key_mgr [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 27 15:05:41 devstack cinder-volume[81326]: INFO cinder.volume.manager [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_db.sqlalchemy.engines [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81326) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 27 15:05:41 devstack cinder-volume[81326]: INFO oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] Starting 1 workers
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] Started child 81538 {{(pid=81326) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] Full set of CONF: {{(pid=81326) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] ******************************************************************************** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] Configuration options gathered from: {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] ================================================================================ {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] allow_availability_zone_fallback = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] allow_compression_on_image_upload = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] allowed_direct_url_schemes     = [] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] api_rate_limit                 = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] auth_strategy                  = keystone {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81538]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_availability_zone      = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_host                   = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_name                   = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_stats_polling_interval = 60 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backup_api_class               = cinder.backup.api.API {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backup_name_template           = backup-%s {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backup_use_same_host           = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backup_use_temp_snapshot       = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] chap_password                  = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] chap_username                  =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cinder_internal_tenant_project_id = d268c45ca89b41f18b40ac392d4efdd2 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cinder_internal_tenant_user_id = 37fa1bc7b9994ff29cbda8d246eb134a {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cluster                        = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] compression_format             = gzip {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] compute_api_class              = cinder.compute.nova.API {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] config_dir                     = [] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] config_source                  = [] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] control_exchange               = openstack {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] debug                          = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] default_availability_zone      = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] default_group_type             = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] default_volume_type            = QuobyteHD {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] disk_geometry                  = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] driver_client_cert             = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] driver_client_cert_key         = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] driver_data_namespace          = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] driver_ssl_cert_path           = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] driver_ssl_cert_verify         = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] driver_use_ssl                 = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] enable_new_services            = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] enable_unsupported_driver      = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] enabled_backends               = ['QuobyteHD'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] enforce_multipath_for_image_xfer = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] filter_function                = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance_api_insecure            = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance_api_servers             = ['http://192.168.122.133/image'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance_api_ssl_compression     = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance_ca_certificates_file    = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance_catalog_info            = image:glance:publicURL {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance_certfile                = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance_keyfile                 = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance_num_retries             = 3 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance_request_timeout         = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] goodness_function              = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] graceful_shutdown_timeout      = 5 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] group_api_class                = cinder.group.api.API {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] host                           = devstack {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] image_compress_on_upload       = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] image_conversion_address_space_limit = 1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] image_conversion_cpu_limit     = 60 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] image_conversion_disable       = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] image_upload_use_cinder_backend = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] image_upload_use_internal_tenant = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] image_volume_cache_enabled     = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] image_volume_cache_max_count   = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] image_volume_cache_max_size_gb = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] init_host_max_objects_retrieval = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] iscsi_target_flags             =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] iscsi_write_cache              = on {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] iser_helper                    = tgtadm {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] iser_ip_address                = 192.168.122.133 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] iser_port                      = 3260 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] log_color                      = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] log_config_append              = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] log_dir                        = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] log_file                       = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] log_options                    = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] log_rotate_interval            = 1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] log_rotate_interval_type       = days {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] log_rotation_type              = none {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] max_age                        = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] max_logfile_count              = 30 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] max_logfile_size_mb            = 200 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] max_over_subscription_ratio    = 20.0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] message_reap_interval          = 86400 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] message_ttl                    = 2592000 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] migration_create_volume_timeout_secs = 300 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] monkey_patch                   = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81538) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] monkey_patch_modules           = [] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] my_ip                          = 192.168.122.133 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] no_snapshot_gb_quota           = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] num_iser_scan_tries            = 3 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] num_shell_tries                = 3 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] num_volume_device_scan_tries   = 3 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] nvmeof_conn_info_version       = 1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] nvmet_ns_id                    = 10 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] nvmet_port_id                  = 1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] osapi_max_limit                = 1000 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] osapi_volume_ext_list          = [] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] osapi_volume_listen_port       = 8776 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] osapi_volume_use_ssl           = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] osapi_volume_workers           = 2 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] per_volume_size_limit          = -1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] periodic_fuzzy_delay           = 60 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] periodic_interval              = 60 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] public_endpoint                = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] publish_errors                 = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] quota_backup_gigabytes         = 1000 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] quota_backups                  = 10 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] quota_gigabytes                = 1000 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] quota_groups                   = 10 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] quota_snapshots                = 10 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] quota_volumes                  = 10 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] rate_limit_burst               = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] rate_limit_except_level        = CRITICAL {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] rate_limit_interval            = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] reinit_driver_count            = 3 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] replication_device             = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] report_discard_supported       = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] report_interval                = 120 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] reservation_clean_interval     = 86400 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] reservation_expire             = 86400 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] reserved_image_namespaces      = [] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] reserved_percentage            = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] rpc_response_timeout           = 120 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] run_external_periodic_tasks    = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] scst_target_driver             = iscsi {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] scst_target_iqn_name           = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] service_down_time              = 720 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] shell_completion               = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] snapshot_name_template         = snapshot-%s {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] split_loggers                  = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] state_path                     = /opt/stack/data/cinder {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] storage_availability_zone      = nova {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] storage_protocol               = iSCSI {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] syslog_log_facility            = LOG_USER {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] target_helper                  = lioadm {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] target_ip_address              = 192.168.122.133 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] target_port                    = 3260 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] target_protocol                = iscsi {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] target_secondary_ip_addresses  = [] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] trace_flags                    = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] transport_url                  = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] until_refresh                  = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] use_chap_auth                  = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] use_default_quota_class        = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] use_journal                    = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] use_json                       = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] use_multipath_for_image_xfer   = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] use_stderr                     = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] use_syslog                     = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] verify_glance_signatures       = enabled {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] volume_api_class               = cinder.volume.api.API {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] volume_backend_name            = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] volume_clear                   = zero {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] volume_clear_ionice            = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] volume_clear_size              = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] volume_copy_bps_limit          = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] volume_dd_blocksize            = 1M {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] volume_name_template           = volume-%s {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] volume_service_inithost_offload = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] volume_usage_audit_period      = month {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] zoning_mode                    = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_concurrency.disable_process_locking = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.admin_password = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.admin_token = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.admin_user  = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.auth_port   = 35357 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.auth_protocol = https {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.auth_section = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.auth_type   = password {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.auth_uri    = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.auth_version = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.cache       = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.certfile    = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.identity_uri = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.include_service_catalog = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.insecure    = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81538) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.interface   = public {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.keyfile     = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_password =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.quobyte [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 27 15:05:41 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.quobyte [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Running cmd (subprocess): mount.quobyte {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcache_username =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.region_name = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.service_type = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.133/identity {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.backend                  = dogpile.cache.null {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.backend_argument         = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.backend_expiration_time  = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.config_prefix            = cache.oslo {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.debug_cache_backend      = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.enable_retry_client      = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.enable_socket_keepalive  = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.enabled                  = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.enforce_fips_mode        = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.expiration_time          = 600 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.hashclient_retry_attempts = 2 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.memcache_dead_retry      = 300 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.memcache_sasl_enabled    = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.password                 = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.proxies                  = [] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.redis_db                 = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.redis_server             = localhost:6379 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.retry_attempts           = 2 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.retry_delay              = 0.0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.socket_keepalive_count   = 1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.socket_keepalive_idle    = 1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.socket_keepalive_interval = 1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.socket_timeout           = 1.0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.tls_allowed_ciphers      = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.tls_cafile               = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.tls_certfile             = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.tls_enabled              = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.tls_keyfile              = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cache.username                 = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] coordination.backend_url       = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.asyncio_connection    = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.asyncio_slave_connection = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.backend               = sqlalchemy {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.connection            = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.connection_debug      = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.connection_parameters =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.connection_recycle_time = 3600 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.connection_trace      = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.db_inc_retry_interval = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.db_max_retries        = 20 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.db_max_retry_interval = 10 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.db_retry_interval     = 1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.max_overflow          = 50 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.max_pool_size         = 5 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.max_retries           = 10 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.mysql_wsrep_sync_wait = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.pool_timeout          = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.retry_interval        = 10 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.slave_connection      = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.sqlite_synchronous    = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.synchronous_reader    = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] database.use_db_reconnect      = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] profiler.connection_string     = messaging:// {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] profiler.enabled               = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] profiler.es_doc_type           = notification {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] profiler.es_scroll_size        = 10000 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] profiler.es_scroll_time        = 2m {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] profiler.filter_error_trace    = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] profiler.hmac_keys             = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] profiler.sentinel_service_name = mymaster {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] profiler.socket_timeout        = 0.1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] profiler.trace_requests        = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] profiler.trace_sqlalchemy      = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] profiler_jaeger.process_tags   = {} {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] profiler_jaeger.service_name_prefix = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] profiler_otlp.service_name_prefix = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_policy.enforce_new_defaults = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: WARNING oslo_config.cfg [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_policy.enforce_scope      = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_policy.policy_default_rule = default {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] privsep_osbrick.group          = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] privsep_osbrick.helper_command = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] privsep_osbrick.user           = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cinder_sys_admin.group         = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cinder_sys_admin.helper_command = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] cinder_sys_admin.user          = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] service_user.auth_section      = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] service_user.auth_type         = password {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] service_user.cafile            = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] service_user.certfile          = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] service_user.collect_timing    = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] service_user.insecure          = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] service_user.keyfile           = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] service_user.send_service_user_token = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] service_user.split_loggers     = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] service_user.timeout           = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance.auth_section            = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance.auth_type               = password {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance.certfile                = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance.collect_timing          = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance.insecure                = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance.keyfile                 = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance.region_name             = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance.split_loggers           = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] glance.timeout                 = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.backend_availability_zone = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.chap_password = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.chap_username =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.disk_geometry = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.driver_client_cert = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.driver_client_cert_key = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.driver_data_namespace = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.driver_use_ssl = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.extra_capabilities = {} {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.filter_function = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack quobyte-client[81540]: Reading configuration file: /etc/quobyte/client.cfg
Apr 27 15:05:41 devstack quobyte-client[81540]: Invalid parameters found, error: missing mount point.
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.goodness_function = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack quobyte-client[81540]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.iscsi_target_flags =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.iscsi_write_cache = on {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.iser_helper   = tgtadm {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack quobyte-client[81540]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.iser_ip_address = 192.168.122.133 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.iser_port     = 3260 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.nas_host      =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.nas_login     = admin {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.nas_mount_options = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.nas_password  = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.nas_private_key =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.nas_share_path =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.num_shell_tries = 3 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.quobyte_volume_url = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.replication_device = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.report_discard_supported = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.reserved_percentage = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.target_helper = tgtadm {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.target_ip_address = 192.168.122.133 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.target_port   = 3260 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.target_protocol = iscsi {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.trace_flags   = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.unique_fqdn_network = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.use_chap_auth = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.volume_backend_name = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.volume_clear  = zero {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.volume_clear_ionice = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.volume_clear_size = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_reports.file_event_handler = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_reports.log_dir           = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.backend_availability_zone = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.backend_host         = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.chap_password        = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.chap_username        = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.chiscsi_conf         = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.disk_geometry        = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.driver_client_cert   = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.driver_data_namespace = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.driver_use_ssl       = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.extra_capabilities   = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.filter_function      = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.goodness_function    = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.iser_helper          = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.iser_ip_address      = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.iser_port            = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.iser_target_prefix   = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.nas_host             = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.nas_login            = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.nas_mount_options    = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.nas_password         = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.nas_private_key      = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.nas_share_path       = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.nas_ssh_port         = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.num_shell_tries      = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.nvmet_port_id        = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.replication_device   = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.report_discard_supported = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.reserved_percentage  = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.scst_target_driver   = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.storage_protocol     = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.target_helper        = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.target_ip_address    = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.target_port          = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack sudo[81542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.target_prefix        = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.target_protocol      = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.trace_flags          = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack sudo[81542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.use_chap_auth        = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.volume_clear         = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.volume_clear_size    = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] QuobyteHD.volumes_dir          = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_notifications.driver = [] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_notifications.retry = -1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] key_manager.fixed_key          = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.barbican_api_version  = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.barbican_endpoint     = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.barbican_endpoint_type = public {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.barbican_region_name  = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.cafile                = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.certfile              = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.collect_timing        = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.insecure              = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.keyfile               = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.number_of_retries     = 60 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.retry_delay           = 1 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.send_service_user_token = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.split_loggers         = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.timeout               = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.verify_ssl            = True {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican.verify_ssl_path       = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican_service_user.auth_section = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican_service_user.auth_type = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican_service_user.cafile   = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican_service_user.certfile = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican_service_user.collect_timing = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican_service_user.insecure = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican_service_user.keyfile  = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican_service_user.split_loggers = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] barbican_service_user.timeout  = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] vault.approle_role_id          = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] vault.approle_secret_id        = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] vault.kv_mountpoint            = secret {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] vault.kv_path                  = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] vault.kv_version               = 2 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] vault.namespace                = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] vault.root_token_id            = **** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] vault.ssl_ca_crt_file          = None {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] vault.timeout                  = 60.0 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] vault.use_ssl                  = False {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 27 15:05:41 devstack cinder-volume[81326]: DEBUG oslo_service.backend._eventlet.service [None req-fc6188c1-8ac1-4862-ada9-dd65c8c8b1e9 None None] ******************************************************************************** {{(pid=81326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 27 15:05:41 devstack sudo[81542]: pam_unix(sudo:session): session closed for user root
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.442s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:05:41 devstack cinder-volume[81538]: INFO cinder.volume.driver [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Driver hasn't implemented _init_vendor_properties()
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG cinder.volume.driver [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327613830566, 'free_capacity_gb': 1775.7327613830566, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81538) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG oslo_db.sqlalchemy.engines [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81538) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writer thread running {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG cinder.db.sqlalchemy.api [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Building query based on filter {{(pid=81538) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81538) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:05:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:05:41 devstack cinder-volume[81538]: INFO cinder.keymgr.migration [None req-45484cda-1442-4c1f-aeda-e5abd0910924 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 27 15:05:41 devstack sudo[81585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:05:41 devstack sudo[81585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:05:42 devstack sudo[81585]: pam_unix(sudo:session): session closed for user root
Apr 27 15:05:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.438s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:05:42 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:05:42 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Driver initialization completed successfully.
Apr 27 15:05:42 devstack cinder-volume[81538]: INFO cinder.manager [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Initiating service 3 cleanup
Apr 27 15:05:42 devstack cinder-volume[81538]: INFO cinder.manager [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Service 3 cleanup completed.
Apr 27 15:05:42 devstack cinder-volume[81538]: DEBUG cinder.service [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Creating RPC server for service cinder-volume {{(pid=81538) start /opt/stack/cinder/cinder/service.py:231}}
Apr 27 15:05:42 devstack cinder-volume[81538]: DEBUG cinder.service [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81538) start /opt/stack/cinder/cinder/service.py:237}}
Apr 27 15:05:42 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 27 15:05:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:05:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:05:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:05:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:05:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:05:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:05:42 devstack sudo[81600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:05:42 devstack sudo[81600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:05:42 devstack sudo[81600]: pam_unix(sudo:session): session closed for user root
Apr 27 15:05:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.452s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:05:42 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5a9ebfae-6e40-4b50-85bc-680642e3ecd5 None None] Driver post RPC initialization completed successfully.
Apr 27 15:05:51 devstack cinder-volume[81326]: DEBUG dbcounter [-] [81326] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81326) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:05:52 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=2 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:05:52 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:06:39 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:06:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Flow 'volume_create_manager' (cb1a378a-73ec-4ff3-b975-a456e546a731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:06:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3dfad6b-b46b-49c2-804d-86343962d402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3dfad6b-b46b-49c2-804d-86343962d402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-840917558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06547860-3b38-4652-a3ca-cf39682180e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='314393aab088439da931ed264fd37724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:06:40Z,use_quota=True,user_id='e1120cd289044dd0918f231515ae2a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f19a05-5fe5-476a-8f77-5475c4eae1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f19a05-5fe5-476a-8f77-5475c4eae1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454aac73-aa28-418c-8c60-f3e5f7541362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454aac73-aa28-418c-8c60-f3e5f7541362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06547860-3b38-4652-a3ca-cf39682180e8', 'volume_name': 'volume-06547860-3b38-4652-a3ca-cf39682180e8', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445c0280-e17b-414c-9647-a90408a6d131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445c0280-e17b-414c-9647-a90408a6d131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3dc967-2cba-4419-ad53-9a2212d764a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:40 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Volume 06547860-3b38-4652-a3ca-cf39682180e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06547860-3b38-4652-a3ca-cf39682180e8', 'volume_size': 1}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-840917558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06547860-3b38-4652-a3ca-cf39682180e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='314393aab088439da931ed264fd37724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:06:40Z,use_quota=True,user_id='e1120cd289044dd0918f231515ae2a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Creating volume 06547860-3b38-4652-a3ca-cf39682180e8 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:06:40 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:06:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-06547860-3b38-4652-a3ca-cf39682180e8 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:40 devstack sudo[81927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-06547860-3b38-4652-a3ca-cf39682180e8 1073741824
Apr 27 15:06:40 devstack sudo[81927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:41 devstack sudo[81927]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-06547860-3b38-4652-a3ca-cf39682180e8 1073741824" returned: 0 in 1.520s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-06547860-3b38-4652-a3ca-cf39682180e8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:41 devstack sudo[82263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-06547860-3b38-4652-a3ca-cf39682180e8
Apr 27 15:06:41 devstack sudo[82263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:42 devstack sudo[82263]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-06547860-3b38-4652-a3ca-cf39682180e8" returned: 0 in 0.934s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] <== create_volume: return (2537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:06:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.539s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:06:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3dc967-2cba-4419-ad53-9a2212d764a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06547860-3b38-4652-a3ca-cf39682180e8', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb2f2b7-f6bc-44d0-abfc-7e310f284e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:42 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Volume volume-06547860-3b38-4652-a3ca-cf39682180e8 (06547860-3b38-4652-a3ca-cf39682180e8): created successfully
Apr 27 15:06:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb2f2b7-f6bc-44d0-abfc-7e310f284e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Flow 'volume_create_manager' (cb1a378a-73ec-4ff3-b975-a456e546a731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:06:42 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5132345a-0b2d-428f-ac5e-92480b5aee48 tempest-VolumesTestJSON-205393099 None] Created volume successfully.
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Flow 'volume_create_manager' (a7fb12e1-3245-45ec-8db2-15d23ad57e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0f2449-0b80-4c90-9126-8d36b4a95509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0f2449-0b80-4c90-9126-8d36b4a95509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1056359245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96be7e99-020e-4f47-9301-153843fab60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66dc052098c14d4a9713f244397ace7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:06:44Z,use_quota=True,user_id='860533ba81af4c749c11e710e1d7ed6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a00533-b3a4-445f-9009-12284beb1dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a00533-b3a4-445f-9009-12284beb1dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beae1aee-17cb-47c0-9be1-4f98c79351c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beae1aee-17cb-47c0-9be1-4f98c79351c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96be7e99-020e-4f47-9301-153843fab60c', 'volume_name': 'volume-96be7e99-020e-4f47-9301-153843fab60c', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9088d0cb-9226-4621-8594-f19a34762a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9088d0cb-9226-4621-8594-f19a34762a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6f8bba-ade4-4680-b100-9ec590d544eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:44 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Volume 96be7e99-020e-4f47-9301-153843fab60c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96be7e99-020e-4f47-9301-153843fab60c', 'volume_size': 1}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1056359245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96be7e99-020e-4f47-9301-153843fab60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66dc052098c14d4a9713f244397ace7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:06:44Z,use_quota=True,user_id='860533ba81af4c749c11e710e1d7ed6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Creating volume 96be7e99-020e-4f47-9301-153843fab60c {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:06:44 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:44 devstack sudo[82292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c 1073741824
Apr 27 15:06:44 devstack sudo[82292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Flow 'volume_create_manager' (6dd2c363-c6e0-4a73-bc87-7091ddd42bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f662a01d-91d9-4332-87e3-b2daca707fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f662a01d-91d9-4332-87e3-b2daca707fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-989917579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fcf6f1-0957-4f49-a4e7-b6f80b434462,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='314393aab088439da931ed264fd37724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:06:45Z,use_quota=True,user_id='e1120cd289044dd0918f231515ae2a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3fbdec-5bef-4e7a-89fc-e46eafeb63df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3fbdec-5bef-4e7a-89fc-e46eafeb63df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb99647-46d6-4505-a565-621ef43809ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb99647-46d6-4505-a565-621ef43809ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3fcf6f1-0957-4f49-a4e7-b6f80b434462', 'volume_name': 'volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a513e36c-97f4-45cd-bb56-b356821d3824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a513e36c-97f4-45cd-bb56-b356821d3824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f371e5-a40f-4bad-9d80-7fffa3ba7b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:44 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Volume b3fcf6f1-0957-4f49-a4e7-b6f80b434462: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462', 'volume_size': 1}
Apr 27 15:06:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:06:45 devstack sudo[82292]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c 1073741824" returned: 0 in 0.911s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:45 devstack sudo[82299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c
Apr 27 15:06:45 devstack sudo[82299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:46 devstack sudo[82299]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c" returned: 0 in 0.615s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.435s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-989917579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fcf6f1-0957-4f49-a4e7-b6f80b434462,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='314393aab088439da931ed264fd37724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:06:45Z,use_quota=True,user_id='e1120cd289044dd0918f231515ae2a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Creating volume b3fcf6f1-0957-4f49-a4e7-b6f80b434462 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:06:46 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6f8bba-ade4-4680-b100-9ec590d544eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96be7e99-020e-4f47-9301-153843fab60c', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5991b703-a1cf-47b1-abf1-27903fe05315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:46 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Volume volume-96be7e99-020e-4f47-9301-153843fab60c (96be7e99-020e-4f47-9301-153843fab60c): created successfully
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5991b703-a1cf-47b1-abf1-27903fe05315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:46 devstack sudo[82307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462 1073741824
Apr 27 15:06:46 devstack sudo[82307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Flow 'volume_create_manager' (a7fb12e1-3245-45ec-8db2-15d23ad57e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:06:46 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-7ecc281d-e7ea-458e-abb9-8a3162b0d5e1 tempest-DeleteServersTestJSON-667127014 None] Created volume successfully.
Apr 27 15:06:47 devstack sudo[82307]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462 1073741824" returned: 0 in 1.102s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:47 devstack sudo[82327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462
Apr 27 15:06:47 devstack sudo[82327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:48 devstack sudo[82327]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462" returned: 0 in 0.614s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:06:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:06:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f371e5-a40f-4bad-9d80-7fffa3ba7b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dc00f6-b35f-48ab-8e58-6d9373f5a5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:48 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Volume volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462 (b3fcf6f1-0957-4f49-a4e7-b6f80b434462): created successfully
Apr 27 15:06:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dc00f6-b35f-48ab-8e58-6d9373f5a5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Flow 'volume_create_manager' (6dd2c363-c6e0-4a73-bc87-7091ddd42bb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:06:48 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b852cf70-4e51-4320-a50c-8619d3f57487 tempest-VolumesTestJSON-205393099 None] Created volume successfully.
Apr 27 15:06:48 devstack cinder-volume[81538]: DEBUG oslo_service.periodic_task [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81538) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:06:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:06:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:06:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:06:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:06:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:06:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:48 devstack sudo[82344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:06:48 devstack sudo[82344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Flow 'volume_create_manager' (b837b1bd-4cc7-4863-995b-798bb4841ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca90c1a-63c7-4337-bdb7-9fd9abfbaa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:50 devstack sudo[82344]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 1.437s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca90c1a-63c7-4337-bdb7-9fd9abfbaa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1758420917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5baa54a-3d7e-4480-b379-949ce86b50c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='314393aab088439da931ed264fd37724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:06:50Z,use_quota=True,user_id='e1120cd289044dd0918f231515ae2a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef6adf4-7cb6-47f0-8de1-d38fa4484e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef6adf4-7cb6-47f0-8de1-d38fa4484e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad8a199-44d7-4d51-ad20-4eab851bdefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad8a199-44d7-4d51-ad20-4eab851bdefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5baa54a-3d7e-4480-b379-949ce86b50c3', 'volume_name': 'volume-b5baa54a-3d7e-4480-b379-949ce86b50c3', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72b6d08-df71-4eac-b7f8-45aa66bd9113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72b6d08-df71-4eac-b7f8-45aa66bd9113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edbc9fa-0854-4527-bb4a-94d960887cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:50 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Volume b5baa54a-3d7e-4480-b379-949ce86b50c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5baa54a-3d7e-4480-b379-949ce86b50c3', 'volume_size': 1}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1758420917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5baa54a-3d7e-4480-b379-949ce86b50c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='314393aab088439da931ed264fd37724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:06:50Z,use_quota=True,user_id='e1120cd289044dd0918f231515ae2a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Creating volume b5baa54a-3d7e-4480-b379-949ce86b50c3 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:06:50 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:06:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b5baa54a-3d7e-4480-b379-949ce86b50c3 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:50 devstack sudo[82381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b5baa54a-3d7e-4480-b379-949ce86b50c3 1073741824
Apr 27 15:06:50 devstack sudo[82381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:52 devstack sudo[82381]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b5baa54a-3d7e-4480-b379-949ce86b50c3 1073741824" returned: 0 in 1.778s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b5baa54a-3d7e-4480-b379-949ce86b50c3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:52 devstack sudo[82420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b5baa54a-3d7e-4480-b379-949ce86b50c3
Apr 27 15:06:52 devstack sudo[82420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:52 devstack sudo[82420]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b5baa54a-3d7e-4480-b379-949ce86b50c3" returned: 0 in 0.594s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] <== create_volume: return (2472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:06:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.479s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:06:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edbc9fa-0854-4527-bb4a-94d960887cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5baa54a-3d7e-4480-b379-949ce86b50c3', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a72613ca-4247-4b98-b14f-cbf224312e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:52 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Volume volume-b5baa54a-3d7e-4480-b379-949ce86b50c3 (b5baa54a-3d7e-4480-b379-949ce86b50c3): created successfully
Apr 27 15:06:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a72613ca-4247-4b98-b14f-cbf224312e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Flow 'volume_create_manager' (b837b1bd-4cc7-4863-995b-798bb4841ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:06:52 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-4672b30c-245a-4177-b222-3ff11f9c995b tempest-VolumesTestJSON-205393099 None] Created volume successfully.
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Flow 'volume_create_manager' (5b31c6d5-68d4-4a5a-bc14-2a1c9a2c1a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb255e9e-8231-4470-978c-9aacaaff25cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb255e9e-8231-4470-978c-9aacaaff25cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1276465037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f03418-8280-4d4d-9aac-9c58711a83a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f281ee3160d04f3c9b9194537397cbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:06:54Z,use_quota=True,user_id='76437df894044c96aaa31c52862adfdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36c7ed0-ebcb-47d7-96c4-c3944eeeb6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36c7ed0-ebcb-47d7-96c4-c3944eeeb6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aaebda6-bbee-4ef6-8549-96f1a8a5abce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aaebda6-bbee-4ef6-8549-96f1a8a5abce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76f03418-8280-4d4d-9aac-9c58711a83a8', 'volume_name': 'volume-76f03418-8280-4d4d-9aac-9c58711a83a8', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed410f82-de6a-4c53-9970-6b8a59200620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed410f82-de6a-4c53-9970-6b8a59200620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82a10bf-5563-44e1-8b6e-715aff5ffd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:54 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Volume 76f03418-8280-4d4d-9aac-9c58711a83a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76f03418-8280-4d4d-9aac-9c58711a83a8', 'volume_size': 1}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1276465037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f03418-8280-4d4d-9aac-9c58711a83a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f281ee3160d04f3c9b9194537397cbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:06:54Z,use_quota=True,user_id='76437df894044c96aaa31c52862adfdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Creating volume 76f03418-8280-4d4d-9aac-9c58711a83a8 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:06:54 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-76f03418-8280-4d4d-9aac-9c58711a83a8 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:54 devstack sudo[82440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-76f03418-8280-4d4d-9aac-9c58711a83a8 1073741824
Apr 27 15:06:54 devstack sudo[82440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:54 devstack cinder-volume[81538]: WARNING py.warnings [req-2ba2e481-6ddb-4fe9-bdf2-09cdfad987da req-7d9446ce-e7cd-4127-af93-79d188cb0ae1 tempest-DeleteServersTestJSON-667127014 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 27 15:06:54 devstack cinder-volume[81538]:   .first()
Apr 27 15:06:54 devstack cinder-volume[81538]: 
Apr 27 15:06:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-2ba2e481-6ddb-4fe9-bdf2-09cdfad987da req-7d9446ce-e7cd-4127-af93-79d188cb0ae1 tempest-DeleteServersTestJSON-667127014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:06:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Acquiring lock "cinder-b5baa54a-3d7e-4480-b379-949ce86b50c3-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:06:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Lock "cinder-b5baa54a-3d7e-4480-b379-949ce86b50c3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:06:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Acquiring lock "cinder-quobyte-b5baa54a-3d7e-4480-b379-949ce86b50c3" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:06:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Lock "cinder-quobyte-b5baa54a-3d7e-4480-b379-949ce86b50c3" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:06:55 devstack cinder-volume[81538]: INFO oslo.privsep.daemon [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzpxufh16/privsep.sock']
Apr 27 15:06:55 devstack sudo[82480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzpxufh16/privsep.sock
Apr 27 15:06:55 devstack sudo[82480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:55 devstack sudo[82440]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-76f03418-8280-4d4d-9aac-9c58711a83a8 1073741824" returned: 0 in 1.222s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-76f03418-8280-4d4d-9aac-9c58711a83a8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:55 devstack sudo[82482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-76f03418-8280-4d4d-9aac-9c58711a83a8
Apr 27 15:06:55 devstack sudo[82482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:55 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 27 15:06:55 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 27 15:06:55 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 27 15:06:55 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 27 15:06:55 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 27 15:06:55 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 27 15:06:55 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 27 15:06:55 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 27 15:06:55 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 27 15:06:56 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 27 15:06:56 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 27 15:06:56 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 27 15:06:56 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 27 15:06:56 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 27 15:06:56 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 27 15:06:56 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 27 15:06:56 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 27 15:06:56 devstack cinder-volume[81538]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 27 15:06:56 devstack sudo[82482]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-76f03418-8280-4d4d-9aac-9c58711a83a8" returned: 0 in 0.765s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:06:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:06:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-2ba2e481-6ddb-4fe9-bdf2-09cdfad987da req-7d9446ce-e7cd-4127-af93-79d188cb0ae1 tempest-DeleteServersTestJSON-667127014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.714s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:06:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82a10bf-5563-44e1-8b6e-715aff5ffd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f03418-8280-4d4d-9aac-9c58711a83a8', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b530c41-08d7-4964-8e7b-ceb6be5ee487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:06:56 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Volume volume-76f03418-8280-4d4d-9aac-9c58711a83a8 (76f03418-8280-4d4d-9aac-9c58711a83a8): created successfully
Apr 27 15:06:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b530c41-08d7-4964-8e7b-ceb6be5ee487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:06:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Flow 'volume_create_manager' (5b31c6d5-68d4-4a5a-bc14-2a1c9a2c1a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:06:56 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-7ad729cf-8212-4b72-8791-bc4a9f08e8be tempest-VolumesAdminNegativeTest-2039954835 None] Created volume successfully.
Apr 27 15:06:56 devstack sudo[82480]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:56 devstack cinder-volume[81538]: INFO oslo.privsep.daemon [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Spawned new privsep daemon via rootwrap
Apr 27 15:06:56 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Accepted privsep connection to /tmp/tmpzpxufh16/privsep.sock {{(pid=81538) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 27 15:06:56 devstack cinder-volume[81538]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 27 15:06:56 devstack cinder-volume[81538]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 27 15:06:56 devstack cinder-volume[81538]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 27 15:06:56 devstack cinder-volume[81538]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82488
Apr 27 15:06:56 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4e9105-7ea1-409d-bbfa-e439ed291674]: (2,) {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:06:56 devstack cinder-volume[81538]: WARNING oslo_privsep.priv_context [req-2ba2e481-6ddb-4fe9-bdf2-09cdfad987da req-7d9446ce-e7cd-4127-af93-79d188cb0ae1 tempest-DeleteServersTestJSON-667127014 None] privsep daemon already running
Apr 27 15:06:56 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f4728c-0986-49e0-a96c-89aef6d311d4]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:06:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-2ba2e481-6ddb-4fe9-bdf2-09cdfad987da req-7d9446ce-e7cd-4127-af93-79d188cb0ae1 tempest-DeleteServersTestJSON-667127014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:56 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aa267f-8587-4f05-8eba-3cea98424409]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:06:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b5baa54a-3d7e-4480-b379-949ce86b50c3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:56 devstack sudo[82491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c
Apr 27 15:06:56 devstack sudo[82492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b5baa54a-3d7e-4480-b379-949ce86b50c3
Apr 27 15:06:56 devstack sudo[82492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:56 devstack sudo[82491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:57 devstack sudo[82492]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b5baa54a-3d7e-4480-b379-949ce86b50c3" returned: 0 in 0.767s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b5baa54a-3d7e-4480-b379-949ce86b50c3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:57 devstack sudo[82501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b5baa54a-3d7e-4480-b379-949ce86b50c3
Apr 27 15:06:57 devstack sudo[82501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:57 devstack sudo[82491]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-2ba2e481-6ddb-4fe9-bdf2-09cdfad987da req-7d9446ce-e7cd-4127-af93-79d188cb0ae1 tempest-DeleteServersTestJSON-667127014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c" returned: 0 in 0.968s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-2ba2e481-6ddb-4fe9-bdf2-09cdfad987da req-7d9446ce-e7cd-4127-af93-79d188cb0ae1 tempest-DeleteServersTestJSON-667127014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.398s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:06:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-2ba2e481-6ddb-4fe9-bdf2-09cdfad987da req-7d9446ce-e7cd-4127-af93-79d188cb0ae1 tempest-DeleteServersTestJSON-667127014 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c', 'name': 'volume-96be7e99-020e-4f47-9301-153843fab60c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f102e1c-ad8d-463e-84b5-c9724a7f061e', 'enforce_multipath': True} {{(pid=81538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 27 15:06:58 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-2ba2e481-6ddb-4fe9-bdf2-09cdfad987da req-7d9446ce-e7cd-4127-af93-79d188cb0ae1 tempest-DeleteServersTestJSON-667127014 None] attachment_update completed successfully.
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Acquiring lock "cinder-76f03418-8280-4d4d-9aac-9c58711a83a8-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Lock "cinder-76f03418-8280-4d4d-9aac-9c58711a83a8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Acquiring lock "cinder-quobyte-76f03418-8280-4d4d-9aac-9c58711a83a8" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Lock "cinder-quobyte-76f03418-8280-4d4d-9aac-9c58711a83a8" acquired by "delete_volume" :: waited 0.028s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a795ac-ff00-4404-a693-e1859c29dff6]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-76f03418-8280-4d4d-9aac-9c58711a83a8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:58 devstack sudo[82501]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b5baa54a-3d7e-4480-b379-949ce86b50c3" returned: 0 in 0.926s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Lock "cinder-quobyte-b5baa54a-3d7e-4480-b379-949ce86b50c3" released by "delete_volume" :: held 3.098s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:06:58 devstack sudo[82505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-76f03418-8280-4d4d-9aac-9c58711a83a8
Apr 27 15:06:58 devstack sudo[82505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:58 devstack cinder-volume[81538]: WARNING cinder.quota [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:06:58 devstack cinder-volume[81538]: WARNING cinder.quota [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Created reservations ['15bbf6e2-6c11-4135-9e90-39d93bc46a1a', '03f21417-b0ed-4c13-a5a9-67aaeb068454', 'b07677d5-009c-4ea6-8f80-d87ec0585fbe', 'e5038d6d-2fbc-4a87-95e3-8721bb61f83a'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:06:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:58 devstack sudo[82508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:06:58 devstack sudo[82508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:59 devstack sudo[82505]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-76f03418-8280-4d4d-9aac-9c58711a83a8" returned: 0 in 1.075s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-76f03418-8280-4d4d-9aac-9c58711a83a8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:06:59 devstack sudo[82581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-76f03418-8280-4d4d-9aac-9c58711a83a8
Apr 27 15:06:59 devstack sudo[82581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:06:59 devstack sudo[82508]: pam_unix(sudo:session): session closed for user root
Apr 27 15:06:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.792s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:06:59 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:06:59 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Deleted volume successfully.
Apr 27 15:06:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e8c33eac-da11-45d9-a01f-5cbe836f6cfc tempest-VolumesTestJSON-205393099 None] Lock "cinder-b5baa54a-3d7e-4480-b379-949ce86b50c3-delete_volume" released by "delete_volume" :: held 4.353s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:06:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Acquiring lock "cinder-b3fcf6f1-0957-4f49-a4e7-b6f80b434462-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:06:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Lock "cinder-b3fcf6f1-0957-4f49-a4e7-b6f80b434462-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Acquiring lock "cinder-quobyte-b3fcf6f1-0957-4f49-a4e7-b6f80b434462" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Lock "cinder-quobyte-b3fcf6f1-0957-4f49-a4e7-b6f80b434462" acquired by "delete_volume" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:00 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cd7540-332b-4796-aba6-a35e179e4204]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:00 devstack sudo[82899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462
Apr 27 15:07:00 devstack sudo[82899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:00 devstack sudo[82581]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-76f03418-8280-4d4d-9aac-9c58711a83a8" returned: 0 in 1.231s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Lock "cinder-quobyte-76f03418-8280-4d4d-9aac-9c58711a83a8" released by "delete_volume" :: held 2.367s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:00 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Created reservations ['0a43674b-bc8b-480c-85ba-a703b546a248', 'c6ced4a1-5c56-4518-b94b-16e2a3d6417a', '4fa62a8a-5638-45f3-aedd-b97fcf4a134b', '05863423-adb9-4902-9b3e-1f9a743b6b45'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:07:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:01 devstack sudo[82905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:07:01 devstack sudo[82905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:01 devstack sudo[82899]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462" returned: 0 in 1.179s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:01 devstack sudo[82910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462
Apr 27 15:07:01 devstack sudo[82910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:01 devstack sudo[82905]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.705s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:01 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:07:01 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Deleted volume successfully.
Apr 27 15:07:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-de8cd342-d4cc-4cb7-8a0b-8ab51ba596c1 tempest-VolumesAdminNegativeTest-2039954835 None] Lock "cinder-76f03418-8280-4d4d-9aac-9c58711a83a8-delete_volume" released by "delete_volume" :: held 3.411s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:02 devstack sudo[82910]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b3fcf6f1-0957-4f49-a4e7-b6f80b434462" returned: 0 in 0.644s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Lock "cinder-quobyte-b3fcf6f1-0957-4f49-a4e7-b6f80b434462" released by "delete_volume" :: held 1.942s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Created reservations ['411068b4-19bd-4170-93f0-6e60969490bd', 'dd485d28-4a8a-415d-9c9d-a7153d400142', '43bed12d-314f-4566-9866-619602936415', '77f669d1-77bf-4c97-9c98-714c0c04636b'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:02 devstack sudo[82916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:07:02 devstack sudo[82916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Acquiring lock "cinder-06547860-3b38-4652-a3ca-cf39682180e8-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Lock "cinder-06547860-3b38-4652-a3ca-cf39682180e8-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Acquiring lock "cinder-quobyte-06547860-3b38-4652-a3ca-cf39682180e8" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Lock "cinder-quobyte-06547860-3b38-4652-a3ca-cf39682180e8" acquired by "delete_volume" :: waited 0.031s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b748ff-249a-44cf-b547-4d55660dc630]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-06547860-3b38-4652-a3ca-cf39682180e8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:02 devstack sudo[82918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-06547860-3b38-4652-a3ca-cf39682180e8
Apr 27 15:07:02 devstack sudo[82918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:03 devstack sudo[82916]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 1.237s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:03 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:07:03 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Deleted volume successfully.
Apr 27 15:07:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13f98585-a745-4e82-9f23-457a2d45970f tempest-VolumesTestJSON-205393099 None] Lock "cinder-b3fcf6f1-0957-4f49-a4e7-b6f80b434462-delete_volume" released by "delete_volume" :: held 3.594s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:03 devstack sudo[82918]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-06547860-3b38-4652-a3ca-cf39682180e8" returned: 0 in 1.035s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-06547860-3b38-4652-a3ca-cf39682180e8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:03 devstack sudo[82970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-06547860-3b38-4652-a3ca-cf39682180e8
Apr 27 15:07:03 devstack sudo[82970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:04 devstack sudo[82970]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-06547860-3b38-4652-a3ca-cf39682180e8" returned: 0 in 0.730s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Lock "cinder-quobyte-06547860-3b38-4652-a3ca-cf39682180e8" released by "delete_volume" :: held 1.822s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:04 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Created reservations ['e821af54-c640-49b8-8d08-273b78e93db1', '213ffc6c-1311-47cc-b64a-82a8be306814', '221e9066-41af-480d-8158-957bcf5642de', '24b1b464-8af8-40ee-8b58-2e8c7c212332'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:07:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:04 devstack sudo[82977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:07:04 devstack sudo[82977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:05 devstack sudo[82977]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.498s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:05 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:07:05 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Deleted volume successfully.
Apr 27 15:07:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4ab88df9-b4c0-4638-9f7d-cb9d430d5868 tempest-VolumesTestJSON-205393099 None] Lock "cinder-06547860-3b38-4652-a3ca-cf39682180e8-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:08 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-8efcc75c-b881-4da9-a68f-ca11b3ee2c2c req-badc181f-8c73-4f19-88c0-db3edf629cdf tempest-DeleteServersTestJSON-667127014 None] Terminate volume connection completed successfully.
Apr 27 15:07:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-8efcc75c-b881-4da9-a68f-ca11b3ee2c2c req-badc181f-8c73-4f19-88c0-db3edf629cdf tempest-DeleteServersTestJSON-667127014 None] Deleting attachment 0f102e1c-ad8d-463e-84b5-c9724a7f061e. {{(pid=81538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 27 15:07:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Acquiring lock "cinder-96be7e99-020e-4f47-9301-153843fab60c-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Lock "cinder-96be7e99-020e-4f47-9301-153843fab60c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Acquiring lock "cinder-quobyte-96be7e99-020e-4f47-9301-153843fab60c" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Lock "cinder-quobyte-96be7e99-020e-4f47-9301-153843fab60c" acquired by "delete_volume" :: waited 0.079s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:13 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffd3bef-7e85-4199-ab70-c6559c0ce9a0]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:13 devstack sudo[83057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c
Apr 27 15:07:13 devstack sudo[83057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:13 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-81a837ae-3736-49f7-a2f0-95b6fc2cd97c tempest-GroupSnapshotsTest-559111101 None] Group tempest-GroupSnapshotsTest-Group-941915599: creating
Apr 27 15:07:13 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-81a837ae-3736-49f7-a2f0-95b6fc2cd97c tempest-GroupSnapshotsTest-559111101 None] Group tempest-GroupSnapshotsTest-Group-941915599: created successfully
Apr 27 15:07:13 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-81a837ae-3736-49f7-a2f0-95b6fc2cd97c tempest-GroupSnapshotsTest-559111101 None] Create group completed successfully.
Apr 27 15:07:13 devstack sudo[83057]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c" returned: 0 in 0.638s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:13 devstack sudo[83062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c
Apr 27 15:07:13 devstack sudo[83062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:14 devstack sudo[83062]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96be7e99-020e-4f47-9301-153843fab60c" returned: 0 in 0.513s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Lock "cinder-quobyte-96be7e99-020e-4f47-9301-153843fab60c" released by "delete_volume" :: held 1.206s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:14 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Created reservations ['f1139382-4c79-42b8-870a-fd0fe84dedb2', '6e8f1ea6-875a-4ae1-9fff-bf47414a8486', 'b1ea99de-f4f5-470c-aee3-1fd4f8126f28', '1e25600b-a3f0-43c8-bbb5-b3127bbddc89'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:07:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:14 devstack sudo[83065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:07:14 devstack sudo[83065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Flow 'volume_create_manager' (9a06da06-660b-4a37-ac8f-0ce494c1a2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c846d7-36e1-4f01-98f4-917c6d867362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c846d7-36e1-4f01-98f4-917c6d867362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1828692485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ae8f7caf-69f9-43b9-be40-cb59f2545233,host='devstack@QuobyteHD#QuobyteHD',id=68ed78c9-946f-4751-babd-eaf75287f216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='981ef9b32ff646ea9f221fa8673da2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:07:15Z,use_quota=True,user_id='f3683e54b4fb492cb60f9c1214e2eacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dbbe0e1-0803-4030-897c-d26364849da7),volume_type_id=1dbbe0e1-0803-4030-897c-d26364849da7)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b0c350-ed9d-4d36-b4f3-47ef4093b1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b0c350-ed9d-4d36-b4f3-47ef4093b1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930931de-c588-41bd-9f67-dc8393ac0193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930931de-c588-41bd-9f67-dc8393ac0193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68ed78c9-946f-4751-babd-eaf75287f216', 'volume_name': 'volume-68ed78c9-946f-4751-babd-eaf75287f216', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea83308b-edb8-477b-9a21-284567588979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea83308b-edb8-477b-9a21-284567588979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:15 devstack sudo[83065]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb416126-10ab-474d-ae38-f9ca102cd972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:15 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Volume 68ed78c9-946f-4751-babd-eaf75287f216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68ed78c9-946f-4751-babd-eaf75287f216', 'volume_size': 1}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ae8f7caf-69f9-43b9-be40-cb59f2545233,created_at=2026-04-27T13:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1828692485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ae8f7caf-69f9-43b9-be40-cb59f2545233,host='devstack@QuobyteHD#QuobyteHD',id=68ed78c9-946f-4751-babd-eaf75287f216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='981ef9b32ff646ea9f221fa8673da2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:07:15Z,use_quota=True,user_id='f3683e54b4fb492cb60f9c1214e2eacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dbbe0e1-0803-4030-897c-d26364849da7),volume_type_id=1dbbe0e1-0803-4030-897c-d26364849da7)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Creating volume 68ed78c9-946f-4751-babd-eaf75287f216 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:07:15 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.589s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:07:15 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Deleted volume successfully.
Apr 27 15:07:15 devstack sudo[83069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216 1073741824
Apr 27 15:07:15 devstack sudo[83069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ca0ce4aa-a9b0-49fb-8f24-29d0e7581c60 tempest-DeleteServersTestJSON-667127014 None] Lock "cinder-96be7e99-020e-4f47-9301-153843fab60c-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:15 devstack sudo[83069]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216 1073741824" returned: 0 in 0.686s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:15 devstack sudo[83074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216
Apr 27 15:07:15 devstack sudo[83074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:16 devstack sudo[83074]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216" returned: 0 in 0.615s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:07:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb416126-10ab-474d-ae38-f9ca102cd972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68ed78c9-946f-4751-babd-eaf75287f216', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bc609b-39d8-485f-89d5-58b6e4fa1986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:16 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Volume volume-68ed78c9-946f-4751-babd-eaf75287f216 (68ed78c9-946f-4751-babd-eaf75287f216): created successfully
Apr 27 15:07:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bc609b-39d8-485f-89d5-58b6e4fa1986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Flow 'volume_create_manager' (9a06da06-660b-4a37-ac8f-0ce494c1a2a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:07:16 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-dd93371e-3cca-4943-afd9-2b5a4c044e10 tempest-GroupSnapshotsTest-559111101 None] Created volume successfully.
Apr 27 15:07:17 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] GroupSnapshot bd56fdc0-17dd-44cd-9011-9e41beb88745: creating.
Apr 27 15:07:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] Group snapshot bd56fdc0-17dd-44cd-9011-9e41beb88745: creating. {{(pid=81538) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 27 15:07:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] Creating offline snapshot 319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c of volume 68ed78c9-946f-4751-babd-eaf75287f216 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:07:17 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b655ba65-cee8-4681-bd36-befbbcc5f1b9]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:17 devstack sudo[83079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216
Apr 27 15:07:17 devstack sudo[83079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:18 devstack sudo[83079]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216" returned: 0 in 0.662s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:18 devstack sudo[83086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c 1G
Apr 27 15:07:18 devstack sudo[83086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:19 devstack sudo[83086]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c 1G" returned: 0 in 0.824s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ed78c9-946f-4751-babd-eaf75287f216 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:19 devstack sudo[83107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ed78c9-946f-4751-babd-eaf75287f216 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c
Apr 27 15:07:19 devstack sudo[83107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:19 devstack sudo[83107]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ed78c9-946f-4751-babd-eaf75287f216 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c" returned: 0 in 0.611s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:19 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c is being set with open permissions: ugo+rw: NotImplementedError
Apr 27 15:07:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:19 devstack sudo[83114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c
Apr 27 15:07:19 devstack sudo[83114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:20 devstack sudo[83114]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c" returned: 0 in 0.514s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:20 devstack sudo[83118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.info
Apr 27 15:07:20 devstack sudo[83118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:20 devstack sudo[83118]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.info" returned: 0 in 0.605s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:20 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 27 15:07:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:21 devstack sudo[83122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.info
Apr 27 15:07:21 devstack sudo[83122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:21 devstack sudo[83122]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.info" returned: 0 in 0.588s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.910s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:21 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-a3acb0ad-7e6a-4649-a74a-3e3b44911af1 tempest-GroupSnapshotsTest-559111101 None] group_snapshot bd56fdc0-17dd-44cd-9011-9e41beb88745: created successfully
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c-d40929ce-7128-4b2a-8912-2b9f1a78e537" by "_create_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c-d40929ce-7128-4b2a-8912-2b9f1a78e537" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Creating volume d40929ce-7128-4b2a-8912-2b9f1a78e537 from snapshot 319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c {{(pid=81538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-d40929ce-7128-4b2a-8912-2b9f1a78e537" by "_copy_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-d40929ce-7128-4b2a-8912-2b9f1a78e537" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] snapshot: 319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c, volume: d40929ce-7128-4b2a-8912-2b9f1a78e537,  {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb91082-057b-4a51-a39e-2ffbc722a7d5]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:23 devstack sudo[83131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c
Apr 27 15:07:23 devstack sudo[83131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:24 devstack sudo[83131]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c" returned: 0 in 0.738s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68ed78c9-946f-4751-babd-eaf75287f216(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:07:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216 {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 27 15:07:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Creating direct copy from snapshot {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 27 15:07:24 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c82cf7-9712-4814-ab00-510217b3333e]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:24 devstack sudo[83136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216
Apr 27 15:07:24 devstack sudo[83136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:25 devstack sudo[83136]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216" returned: 0 in 0.597s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:25 devstack cinder-volume[81538]: DEBUG cinder.utils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Path /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537 not found in is_blk_device check {{(pid=81538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 27 15:07:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:25 devstack sudo[83141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537
Apr 27 15:07:25 devstack sudo[83141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:33 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=48,cinder:UPDATE=67,cinder:INSERT=10,cinder:DELETE=2 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:07:33 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:UPDATE=58,cinder:SELECT=59,cinder:DELETE=9,cinder:INSERT=17 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:07:34 devstack sudo[83141]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537" returned: 0 in 9.695s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:34 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[882a614a-222f-4a1c-aa26-70d425ac82d1]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:34 devstack sudo[83223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216
Apr 27 15:07:34 devstack sudo[83223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:35 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:07:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Flow 'volume_create_manager' (f22b01bf-9874-4e5d-8991-1f6baa5f8fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:07:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61dac4eb-ec8d-4b29-a16b-aab57b05bb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61dac4eb-ec8d-4b29-a16b-aab57b05bb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-168349021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef16bb4a-e08b-4416-85b3-6b2bf80478ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c92858242b9498aa00f1d9534329e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:07:36Z,use_quota=True,user_id='e301274e5a27497fbf1789673795edad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17af1f97-6c0b-4fc1-b363-7252b108d128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17af1f97-6c0b-4fc1-b363-7252b108d128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a998a7ad-478e-4d2f-97db-c9d619737c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a998a7ad-478e-4d2f-97db-c9d619737c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef16bb4a-e08b-4416-85b3-6b2bf80478ae', 'volume_name': 'volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3cd6bc0-857c-4274-a6d2-8caa7b532d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3cd6bc0-857c-4274-a6d2-8caa7b532d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e5910d-41aa-49b5-8c86-89df7ff74ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:35 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Volume ef16bb4a-e08b-4416-85b3-6b2bf80478ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae', 'volume_size': 1}
Apr 27 15:07:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:36 devstack sudo[83223]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216" returned: 0 in 1.525s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216, size 1024.00 MB, duration 9.70 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537 {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:07:36 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Converted 1024.00 MB image at 105.61 MB/s
Apr 27 15:07:36 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537 is being set with open permissions: ugo+rw: NotImplementedError
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:36 devstack sudo[83230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537
Apr 27 15:07:36 devstack sudo[83230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:36 devstack sudo[83230]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537" returned: 0 in 0.680s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-d40929ce-7128-4b2a-8912-2b9f1a78e537" released by "_copy_volume_from_snapshot" :: held 13.447s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c-d40929ce-7128-4b2a-8912-2b9f1a78e537" released by "_create_volume_from_snapshot" :: held 13.501s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.521s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.224s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-168349021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef16bb4a-e08b-4416-85b3-6b2bf80478ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c92858242b9498aa00f1d9534329e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:07:36Z,use_quota=True,user_id='e301274e5a27497fbf1789673795edad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Creating volume ef16bb4a-e08b-4416-85b3-6b2bf80478ae {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:07:36 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:07:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:37 devstack sudo[83234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae 1073741824
Apr 27 15:07:37 devstack sudo[83234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:37 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e0df3b9a-d445-49c8-bac1-278dae0963ce tempest-GroupSnapshotsTest-559111101 None] Create group from source-snapshot-bd56fdc0-17dd-44cd-9011-9e41beb88745 completed successfully.
Apr 27 15:07:37 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-d40929ce-7128-4b2a-8912-2b9f1a78e537" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:37 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-d40929ce-7128-4b2a-8912-2b9f1a78e537" acquired by "delete_volume" :: waited 0.032s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:37 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b80187-4d49-424f-bd8c-77b09434da33]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:37 devstack sudo[83236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537
Apr 27 15:07:37 devstack sudo[83236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:38 devstack sudo[83234]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae 1073741824" returned: 0 in 1.190s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:38 devstack sudo[83242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae
Apr 27 15:07:38 devstack sudo[83242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:38 devstack sudo[83236]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537" returned: 0 in 0.715s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:38 devstack sudo[83247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537
Apr 27 15:07:38 devstack sudo[83247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:38 devstack sudo[83242]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae" returned: 0 in 0.557s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:07:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e5910d-41aa-49b5-8c86-89df7ff74ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5285679f-abc1-48df-8733-1d8142af40ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:38 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Volume volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae (ef16bb4a-e08b-4416-85b3-6b2bf80478ae): created successfully
Apr 27 15:07:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5285679f-abc1-48df-8733-1d8142af40ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Flow 'volume_create_manager' (f22b01bf-9874-4e5d-8991-1f6baa5f8fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:07:38 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-7fafed78-0c9b-48bd-822f-fea3c88405ca req-96ce5789-cf1a-4bc8-8f07-0f259223f707 tempest-VolumesSnapshotsTestJSON-436813273 None] Created volume successfully.
Apr 27 15:07:39 devstack sudo[83247]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d40929ce-7128-4b2a-8912-2b9f1a78e537" returned: 0 in 0.703s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-d40929ce-7128-4b2a-8912-2b9f1a78e537" released by "delete_volume" :: held 1.477s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:39 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Created reservations ['4670b374-f518-4b7d-9baf-8d5062961299'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:07:39 devstack cinder-volume[81538]: WARNING cinder.quota [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1220018687 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1220018687, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:07:39 devstack cinder-volume[81538]: WARNING cinder.quota [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1220018687 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1220018687, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:07:39 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Created reservations ['a4e4da1d-36e9-4899-be1b-fdd318631af3', 'b7327107-87cf-447f-a354-ea120fac8083', 'ba2c1763-4102-411b-a3a4-2107b9523a7f', 'a8b6f064-3a8e-4e82-be95-f59909895d76'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:07:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:39 devstack sudo[83270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:07:39 devstack sudo[83270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:40 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] group_snapshot bd56fdc0-17dd-44cd-9011-9e41beb88745: deleting
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] group_snapshot bd56fdc0-17dd-44cd-9011-9e41beb88745: deleting {{(pid=81538) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-68ed78c9-946f-4751-babd-eaf75287f216" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:40 devstack sudo[83270]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.996s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-68ed78c9-946f-4751-babd-eaf75287f216" acquired by "delete_snapshot" :: waited 0.157s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:40 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-58ebfba3-784e-4e53-9cbe-d3fb2cfa044d tempest-GroupSnapshotsTest-559111101 None] Delete group completed successfully.
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] Creating offline snapshot f8a1d2cd-7b82-4436-b753-3694edaf077b of volume ef16bb4a-e08b-4416-85b3-6b2bf80478ae {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] Deleting offline snapshot 319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c of volume 68ed78c9-946f-4751-babd-eaf75287f216 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] snapshot_file for this snap is: volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee46925e-a6c9-4113-9adf-a465bfc43d68]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8d9c0d-6914-466c-bc0c-c10a02f176d9]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:40 devstack sudo[83288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae
Apr 27 15:07:40 devstack sudo[83288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:40 devstack sudo[83289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c
Apr 27 15:07:40 devstack sudo[83289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:41 devstack sudo[83289]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c" returned: 0 in 0.716s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68ed78c9-946f-4751-babd-eaf75287f216(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:07:41 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e57f2a-d481-415c-ac32-bd6cc3804c11]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:41 devstack sudo[83334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216
Apr 27 15:07:41 devstack sudo[83334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:41 devstack sudo[83288]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae" returned: 0 in 0.898s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:41 devstack sudo[83336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b 1G
Apr 27 15:07:41 devstack sudo[83336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:42 devstack sudo[83334]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216" returned: 0 in 0.700s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:42 devstack sudo[83347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c
Apr 27 15:07:42 devstack sudo[83347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:42 devstack sudo[83336]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b 1G" returned: 0 in 0.784s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:42 devstack sudo[83350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b
Apr 27 15:07:42 devstack sudo[83350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:43 devstack sudo[83347]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c" returned: 0 in 0.890s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:43 devstack sudo[83361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c
Apr 27 15:07:43 devstack sudo[83361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:43 devstack sudo[83350]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b" returned: 0 in 0.834s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:43 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b is being set with open permissions: ugo+rw
Apr 27 15:07:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:43 devstack sudo[83366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b
Apr 27 15:07:43 devstack sudo[83366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:43 devstack sudo[83361]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216.319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c" returned: 0 in 0.639s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-319ac2a3-d9c2-4a0a-9b0f-d99829c2bd0c" released by "_delete_snapshot" :: held 3.068s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-68ed78c9-946f-4751-babd-eaf75287f216" released by "delete_snapshot" :: held 3.126s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:43 devstack cinder-volume[81538]: WARNING cinder.quota [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1220018687 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1220018687, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:07:43 devstack sudo[83366]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b" returned: 0 in 0.668s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:43 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] Created reservations ['18ce8b96-ca71-4077-9594-22b49e55abcf', 'abca8775-b5a8-4d33-84b5-d33db5fed9b2', '4eabcd29-c763-42e4-bb36-90724734bfa6', '80df7744-10c4-420b-b11b-770db08395e8'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:07:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:43 devstack sudo[83373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.info
Apr 27 15:07:43 devstack sudo[83373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:44 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-9ce90d64-fc03-465f-b111-a985e6bcf763 tempest-GroupSnapshotsTest-559111101 None] group_snapshot bd56fdc0-17dd-44cd-9011-9e41beb88745: deleted successfully
Apr 27 15:07:44 devstack sudo[83373]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.info" returned: 0 in 0.614s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:44 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.info is being set with open permissions: ugo+rw
Apr 27 15:07:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:44 devstack sudo[83376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.info
Apr 27 15:07:44 devstack sudo[83376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:45 devstack sudo[83376]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.info" returned: 0 in 0.524s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.452s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-68ed78c9-946f-4751-babd-eaf75287f216" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-68ed78c9-946f-4751-babd-eaf75287f216" acquired by "delete_volume" :: waited 0.030s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:45 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-bc160ea7-8e8e-4929-ab4d-95fdc2cac706 req-f06d0f08-3396-4eac-88a4-28791994bced tempest-VolumesSnapshotsTestJSON-436813273 None] Create snapshot completed successfully
Apr 27 15:07:45 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7088188e-440f-48b6-aca1-6cd5af54ff2e]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:45 devstack sudo[83386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216
Apr 27 15:07:45 devstack sudo[83386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:45 devstack sudo[83386]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216" returned: 0 in 0.720s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:45 devstack sudo[83395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216
Apr 27 15:07:45 devstack sudo[83395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Acquiring lock "cinder-f8a1d2cd-7b82-4436-b753-3694edaf077b-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "cinder-f8a1d2cd-7b82-4436-b753-3694edaf077b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Acquiring lock "cinder-quobyte-ef16bb4a-e08b-4416-85b3-6b2bf80478ae" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "cinder-quobyte-ef16bb4a-e08b-4416-85b3-6b2bf80478ae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Acquiring lock "cinder-quobyte-f8a1d2cd-7b82-4436-b753-3694edaf077b" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "cinder-quobyte-f8a1d2cd-7b82-4436-b753-3694edaf077b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Deleting offline snapshot f8a1d2cd-7b82-4436-b753-3694edaf077b of volume ef16bb4a-e08b-4416-85b3-6b2bf80478ae {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] snapshot_file for this snap is: volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fb4cc8-c63b-4865-a4b7-e0b464b707a5]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:46 devstack sudo[83399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b
Apr 27 15:07:46 devstack sudo[83399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:46 devstack sudo[83395]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68ed78c9-946f-4751-babd-eaf75287f216" returned: 0 in 0.497s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-68ed78c9-946f-4751-babd-eaf75287f216" released by "delete_volume" :: held 1.292s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Created reservations ['98504039-efab-4cae-94bb-2b06ab683787'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:07:46 devstack cinder-volume[81538]: WARNING cinder.db.sqlalchemy.api [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1220018687']
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Created reservations ['57d27bda-e43e-4d44-bea8-375771b46787', '6eeefa9c-7c8d-4b34-a6ef-484b873cf9ed', '2e92cc8d-c99c-409b-9a79-0c12fab2606d', 'd2642752-e0c6-4735-9644-e6cfe0c724a9'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:46 devstack sudo[83403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:07:46 devstack sudo[83403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:46 devstack sudo[83399]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b" returned: 0 in 0.671s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea76563-be8b-41db-a5ce-2b1528730bd4]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:47 devstack sudo[83409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae
Apr 27 15:07:47 devstack sudo[83409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:47 devstack sudo[83403]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.503s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:47 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:07:47 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-dbc79f5a-ea24-4953-b347-3d3e033f5ea3 tempest-GroupSnapshotsTest-559111101 None] Delete group completed successfully.
Apr 27 15:07:47 devstack sudo[83409]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae" returned: 0 in 0.805s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:47 devstack sudo[83415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b
Apr 27 15:07:47 devstack sudo[83415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:47 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-c5de726f-2dc6-4866-b7c5-751380145843 tempest-GroupSnapshotsTest-559111101 None] Group tempest-GroupSnapshotsTest-Group-1880729351: creating
Apr 27 15:07:47 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-c5de726f-2dc6-4866-b7c5-751380145843 tempest-GroupSnapshotsTest-559111101 None] Group tempest-GroupSnapshotsTest-Group-1880729351: created successfully
Apr 27 15:07:47 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-c5de726f-2dc6-4866-b7c5-751380145843 tempest-GroupSnapshotsTest-559111101 None] Create group completed successfully.
Apr 27 15:07:48 devstack sudo[83415]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b" returned: 0 in 0.760s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:48 devstack sudo[83421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b
Apr 27 15:07:48 devstack sudo[83421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:48 devstack cinder-volume[81538]: DEBUG oslo_service.periodic_task [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81538) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:07:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:48 devstack sudo[83424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:07:48 devstack sudo[83424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:49 devstack sudo[83421]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae.f8a1d2cd-7b82-4436-b753-3694edaf077b" returned: 0 in 0.599s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "cinder-quobyte-f8a1d2cd-7b82-4436-b753-3694edaf077b" released by "_delete_snapshot" :: held 2.983s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "cinder-quobyte-ef16bb4a-e08b-4416-85b3-6b2bf80478ae" released by "delete_snapshot" :: held 3.013s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:49 devstack cinder-volume[81538]: WARNING cinder.quota [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.quota [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Created reservations ['c229c574-82f8-4519-9475-35d19216625b', '1753a24a-b225-4362-98a9-52c37e11ba89', 'd639b017-feb1-4309-a930-fd9f98e1fff4', '98498bc1-a2ff-4f60-963a-e474774c7414'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:07:49 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Delete snapshot completed successfully.
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-249f15ad-a0c1-4da9-ae52-3f2f91137265 req-1398a3d9-7906-404a-a585-64509faa3b1b tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "cinder-f8a1d2cd-7b82-4436-b753-3694edaf077b-delete_snapshot" released by "delete_snapshot" :: held 3.236s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Acquiring lock "cinder-ef16bb4a-e08b-4416-85b3-6b2bf80478ae-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "cinder-ef16bb4a-e08b-4416-85b3-6b2bf80478ae-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:49 devstack sudo[83424]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.768s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Acquiring lock "cinder-quobyte-ef16bb4a-e08b-4416-85b3-6b2bf80478ae" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "cinder-quobyte-ef16bb4a-e08b-4416-85b3-6b2bf80478ae" acquired by "delete_volume" :: waited 0.036s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ae1f14-bd6e-4a3b-804f-89cf78630d6b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:49 devstack sudo[83444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae
Apr 27 15:07:49 devstack sudo[83444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Flow 'volume_create_manager' (4eeb4e6c-6154-4e0d-bdfc-76e1e9ac6e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f210062d-aaad-4a90-8c19-cd7c2a2b53f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f210062d-aaad-4a90-8c19-cd7c2a2b53f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1365687932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7121d976-0f4f-4932-8f3d-b3247f0fd6b0,host='devstack@QuobyteHD#QuobyteHD',id=ac4891b7-06de-42e0-8154-8a58dc2c87f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='981ef9b32ff646ea9f221fa8673da2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:07:50Z,use_quota=True,user_id='f3683e54b4fb492cb60f9c1214e2eacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e1e5517-d0e0-41e1-bf3c-db6b6fe268ad),volume_type_id=2e1e5517-d0e0-41e1-bf3c-db6b6fe268ad)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82be9fb1-e377-4794-a421-661bde45e332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82be9fb1-e377-4794-a421-661bde45e332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecedc64-7b5a-440f-9089-16ab5cc2129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecedc64-7b5a-440f-9089-16ab5cc2129b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac4891b7-06de-42e0-8154-8a58dc2c87f8', 'volume_name': 'volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcae25a3-1edd-41dd-a452-c6e58352ab7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcae25a3-1edd-41dd-a452-c6e58352ab7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29d15de-4125-42fb-a614-8f819c42b3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:49 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Volume ac4891b7-06de-42e0-8154-8a58dc2c87f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8', 'volume_size': 1}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7121d976-0f4f-4932-8f3d-b3247f0fd6b0,created_at=2026-04-27T13:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1365687932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7121d976-0f4f-4932-8f3d-b3247f0fd6b0,host='devstack@QuobyteHD#QuobyteHD',id=ac4891b7-06de-42e0-8154-8a58dc2c87f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='981ef9b32ff646ea9f221fa8673da2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:07:50Z,use_quota=True,user_id='f3683e54b4fb492cb60f9c1214e2eacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e1e5517-d0e0-41e1-bf3c-db6b6fe268ad),volume_type_id=2e1e5517-d0e0-41e1-bf3c-db6b6fe268ad)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Creating volume ac4891b7-06de-42e0-8154-8a58dc2c87f8 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:07:49 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:07:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:50 devstack sudo[83448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8 1073741824
Apr 27 15:07:50 devstack sudo[83448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:50 devstack sudo[83444]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae" returned: 0 in 0.786s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:50 devstack sudo[83453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae
Apr 27 15:07:50 devstack sudo[83453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:50 devstack sudo[83448]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8 1073741824" returned: 0 in 0.952s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:50 devstack sudo[83458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8
Apr 27 15:07:50 devstack sudo[83458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:51 devstack sudo[83453]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef16bb4a-e08b-4416-85b3-6b2bf80478ae" returned: 0 in 0.571s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "cinder-quobyte-ef16bb4a-e08b-4416-85b3-6b2bf80478ae" released by "delete_volume" :: held 1.447s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG cinder.quota [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Created reservations ['5bfff2f3-b7ac-456f-8700-012a9656a439', '61ab41a0-24b0-4de6-9cf9-3ca5c259d29c', '19a50b43-e826-47b8-9dd9-daef12420e37', '46a48e54-7a82-4854-ae42-b839c32cab3c'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:51 devstack sudo[83462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:07:51 devstack sudo[83462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:51 devstack sudo[83458]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8" returned: 0 in 0.776s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29d15de-4125-42fb-a614-8f819c42b3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b99956b-6676-4688-908c-8fb3a92bdd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:51 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Volume volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8 (ac4891b7-06de-42e0-8154-8a58dc2c87f8): created successfully
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b99956b-6676-4688-908c-8fb3a92bdd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Flow 'volume_create_manager' (4eeb4e6c-6154-4e0d-bdfc-76e1e9ac6e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:07:51 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-2411150b-031e-48f3-a175-54da07598606 tempest-GroupSnapshotsTest-559111101 None] Created volume successfully.
Apr 27 15:07:52 devstack sudo[83462]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.707s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.manager [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:07:52 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Deleted volume successfully.
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-5d83c8fd-f9aa-47a4-bdd5-1779ae4f0534 req-5babc395-0a28-4837-bf6e-3e0e2496de9b tempest-VolumesSnapshotsTestJSON-436813273 None] Lock "cinder-ef16bb4a-e08b-4416-85b3-6b2bf80478ae-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Flow 'volume_create_manager' (d7c3488d-37f3-4fd3-9a09-e58f932f8731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0e5cba-3101-40c5-bfab-8de7a65a0358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0e5cba-3101-40c5-bfab-8de7a65a0358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1617128240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7121d976-0f4f-4932-8f3d-b3247f0fd6b0,host='devstack@QuobyteHD#QuobyteHD',id=509cf519-59ab-4db0-8f6e-7f957501620c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='981ef9b32ff646ea9f221fa8673da2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:07:52Z,use_quota=True,user_id='f3683e54b4fb492cb60f9c1214e2eacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e1e5517-d0e0-41e1-bf3c-db6b6fe268ad),volume_type_id=2e1e5517-d0e0-41e1-bf3c-db6b6fe268ad)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab0226d-ac59-42ae-a6fc-9fe490e7dfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab0226d-ac59-42ae-a6fc-9fe490e7dfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20da9ce-3ebe-4090-a6a3-29c2719f58a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20da9ce-3ebe-4090-a6a3-29c2719f58a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509cf519-59ab-4db0-8f6e-7f957501620c', 'volume_name': 'volume-509cf519-59ab-4db0-8f6e-7f957501620c', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509b8409-3299-4f2c-9753-32bfbcc310ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509b8409-3299-4f2c-9753-32bfbcc310ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98a843c-72c9-4b64-aee0-f6f347356a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:52 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Volume 509cf519-59ab-4db0-8f6e-7f957501620c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509cf519-59ab-4db0-8f6e-7f957501620c', 'volume_size': 1}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7121d976-0f4f-4932-8f3d-b3247f0fd6b0,created_at=2026-04-27T13:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1617128240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7121d976-0f4f-4932-8f3d-b3247f0fd6b0,host='devstack@QuobyteHD#QuobyteHD',id=509cf519-59ab-4db0-8f6e-7f957501620c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='981ef9b32ff646ea9f221fa8673da2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:07:52Z,use_quota=True,user_id='f3683e54b4fb492cb60f9c1214e2eacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e1e5517-d0e0-41e1-bf3c-db6b6fe268ad),volume_type_id=2e1e5517-d0e0-41e1-bf3c-db6b6fe268ad)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Creating volume 509cf519-59ab-4db0-8f6e-7f957501620c {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:07:52 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:07:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:52 devstack sudo[83482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c 1073741824
Apr 27 15:07:52 devstack sudo[83482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:53 devstack sudo[83482]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c 1073741824" returned: 0 in 0.770s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:53 devstack sudo[83490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c
Apr 27 15:07:53 devstack sudo[83490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:53 devstack sudo[83490]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c" returned: 0 in 0.574s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:07:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98a843c-72c9-4b64-aee0-f6f347356a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509cf519-59ab-4db0-8f6e-7f957501620c', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613bb74f-c96b-4eb6-b2be-044dc07d9bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:53 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Volume volume-509cf519-59ab-4db0-8f6e-7f957501620c (509cf519-59ab-4db0-8f6e-7f957501620c): created successfully
Apr 27 15:07:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613bb74f-c96b-4eb6-b2be-044dc07d9bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Flow 'volume_create_manager' (d7c3488d-37f3-4fd3-9a09-e58f932f8731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:07:54 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-05509ceb-049f-4ea0-982f-eb020de8d53d tempest-GroupSnapshotsTest-559111101 None] Created volume successfully.
Apr 27 15:07:54 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-fb1508da-573d-4978-b161-0736f315708c tempest-GroupSnapshotsTest-559111101 None] Update group completed successfully.
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Flow 'volume_create_manager' (04d839e6-303f-4493-8dbf-25d313dbdc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480629cb-3070-4f4a-9e2f-87057c3bca35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480629cb-3070-4f4a-9e2f-87057c3bca35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:07:56Z,deleted=False,deleted_at=None,display_description='',display_name='5fe4111a-3772-4bb7-8437-eefd567aba22-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467a7a5c-40d1-4d3b-afdb-4bb63800e9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c0076463854a69a33466a2bd535c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:07:56Z,use_quota=True,user_id='55a2a8edb5754afc843101fd00a1bcda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239d4aea-2d20-4cc5-8654-9a48c175bd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239d4aea-2d20-4cc5-8654-9a48c175bd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f1ea3f-5b49-4990-bffc-b37482ab43c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f1ea3f-5b49-4990-bffc-b37482ab43c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '467a7a5c-40d1-4d3b-afdb-4bb63800e9a6', 'volume_name': 'volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da50be3-562f-476f-8332-f4a821f6bb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da50be3-562f-476f-8332-f4a821f6bb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fdafc6-4e97-4a50-b7a4-1507b33b93eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:56 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Volume 467a7a5c-40d1-4d3b-afdb-4bb63800e9a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6', 'volume_size': 1}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:07:56Z,deleted=False,deleted_at=None,display_description='',display_name='5fe4111a-3772-4bb7-8437-eefd567aba22-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467a7a5c-40d1-4d3b-afdb-4bb63800e9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c0076463854a69a33466a2bd535c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:07:56Z,use_quota=True,user_id='55a2a8edb5754afc843101fd00a1bcda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Creating volume 467a7a5c-40d1-4d3b-afdb-4bb63800e9a6 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:07:56 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:07:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:56 devstack sudo[83589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6 1073741824
Apr 27 15:07:56 devstack sudo[83589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:56 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-cc9107ce-16b3-4c2f-a1cb-23c92e0a7aa9 tempest-GroupSnapshotsTest-559111101 None] Update group completed successfully.
Apr 27 15:07:57 devstack sudo[83589]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6 1073741824" returned: 0 in 0.984s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:07:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2008119c-a161-4389-af07-070b552fc8e1 tempest-BackendsCapabilitiesAdminTestsJSON-1237728849 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327613830566, 'free_capacity_gb': 1775.7327613830566, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81538) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 27 15:07:57 devstack sudo[83606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6
Apr 27 15:07:57 devstack sudo[83606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:07:57 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-1b33f024-8592-4f1b-88ee-013aa0ea0cdc tempest-GroupSnapshotsTest-559111101 None] Update group completed successfully.
Apr 27 15:07:58 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1b64c65a-1bfe-479d-b4b9-9af3ee4fc62a tempest-BackendsCapabilitiesAdminTestsJSON-1237728849 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327613830566, 'free_capacity_gb': 1775.7327613830566, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81538) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 27 15:07:58 devstack sudo[83606]: pam_unix(sudo:session): session closed for user root
Apr 27 15:07:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6" returned: 0 in 0.966s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:07:58 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:07:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:07:58 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fdafc6-4e97-4a50-b7a4-1507b33b93eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:58 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c693f3-4c17-4cbf-a94c-dc6379243921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:07:58 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Volume volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6 (467a7a5c-40d1-4d3b-afdb-4bb63800e9a6): created successfully
Apr 27 15:07:58 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c693f3-4c17-4cbf-a94c-dc6379243921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:07:58 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Flow 'volume_create_manager' (04d839e6-303f-4493-8dbf-25d313dbdc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:07:58 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-f278823d-343f-4d79-8536-44649ad3339d tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Created volume successfully.
Apr 27 15:07:59 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ed7f2049-dd97-4650-be8b-6142511b631a tempest-GroupSnapshotsTest-559111101 None] Update group completed successfully.
Apr 27 15:08:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-54c50664-d825-4253-b08b-1ba92b210053 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-54c50664-d825-4253-b08b-1ba92b210053 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:00 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa158d02-4183-49cd-a825-5aae83fa23be]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-54c50664-d825-4253-b08b-1ba92b210053 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:00 devstack sudo[83659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6
Apr 27 15:08:00 devstack sudo[83659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:01 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] GroupSnapshot eb28d115-ead8-4be1-9345-9876301e306c: creating.
Apr 27 15:08:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Group snapshot eb28d115-ead8-4be1-9345-9876301e306c: creating. {{(pid=81538) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 27 15:08:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:01 devstack sudo[83659]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-54c50664-d825-4253-b08b-1ba92b210053 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6" returned: 0 in 1.048s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-54c50664-d825-4253-b08b-1ba92b210053 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.092s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.380s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-54c50664-d825-4253-b08b-1ba92b210053 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c', 'name': 'volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9b04b06-7d3e-496f-9044-3b4f8f1ce8b8', 'enforce_multipath': True} {{(pid=81538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 27 15:08:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Creating offline snapshot 9341ab74-84ca-458d-8c3c-059e7d2bdeef of volume ac4891b7-06de-42e0-8154-8a58dc2c87f8 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:08:02 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffddf19c-2e85-4f8a-876b-0e106358c172]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:02 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-beba48e3-7ef3-454a-8b76-e77976f44afe req-54c50664-d825-4253-b08b-1ba92b210053 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] attachment_update completed successfully.
Apr 27 15:08:02 devstack sudo[83666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8
Apr 27 15:08:02 devstack sudo[83666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:03 devstack sudo[83666]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8" returned: 0 in 1.238s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:03 devstack sudo[83671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef 1G
Apr 27 15:08:03 devstack sudo[83671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:05 devstack sudo[83671]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef 1G" returned: 0 in 1.927s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:05 devstack sudo[83744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef
Apr 27 15:08:05 devstack sudo[83744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:06 devstack sudo[83744]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef" returned: 0 in 0.793s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:06 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef is being set with open permissions: ugo+rw: NotImplementedError
Apr 27 15:08:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:06 devstack sudo[83753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef
Apr 27 15:08:06 devstack sudo[83753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:06 devstack sudo[83753]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef" returned: 0 in 0.515s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:06 devstack sudo[83756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.info
Apr 27 15:08:06 devstack sudo[83756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:07 devstack sudo[83756]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.info" returned: 0 in 0.839s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:07 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 27 15:08:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:07 devstack sudo[83760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.info
Apr 27 15:08:07 devstack sudo[83760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:08 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-9612ad40-e9ff-43c3-9737-530d020e277d tempest-GroupSnapshotsV319Test-1901591764 None] Group tempest-GroupSnapshotsV319Test-Group-335829983: creating
Apr 27 15:08:08 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-9612ad40-e9ff-43c3-9737-530d020e277d tempest-GroupSnapshotsV319Test-1901591764 None] Group tempest-GroupSnapshotsV319Test-Group-335829983: created successfully
Apr 27 15:08:08 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-9612ad40-e9ff-43c3-9737-530d020e277d tempest-GroupSnapshotsV319Test-1901591764 None] Create group completed successfully.
Apr 27 15:08:08 devstack sudo[83760]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.info" returned: 0 in 1.370s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.928s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Creating offline snapshot af4bc98e-7197-4e36-b597-05e34ad455c7 of volume 509cf519-59ab-4db0-8f6e-7f957501620c {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:08:08 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[416d3522-092a-471f-8fdf-6238b31b29d8]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:08 devstack sudo[84100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c
Apr 27 15:08:08 devstack sudo[84100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:09 devstack sudo[84100]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c" returned: 0 in 1.003s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:09 devstack sudo[84149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7 1G
Apr 27 15:08:09 devstack sudo[84149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Flow 'volume_create_manager' (6f4efdd1-b913-4ba1-a46e-bbe4ea7de9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8390c33-6067-4567-a640-8fedd59d9e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8390c33-6067-4567-a640-8fedd59d9e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1225320035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=98656f98-7dc1-4e2b-9f83-12ea996868b1,host='devstack@QuobyteHD#QuobyteHD',id=1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733041db637c49a3b0a88b1df1ab1648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:08:11Z,use_quota=True,user_id='a76a8360501d4fafbb5eb54e504cd100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed42f1af-4932-476c-b130-409662cdbe20),volume_type_id=ed42f1af-4932-476c-b130-409662cdbe20)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0957af1a-8835-4cc0-b2e1-4e983d6ae0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0957af1a-8835-4cc0-b2e1-4e983d6ae0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae7a320-da80-4629-803f-13f60e055084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae7a320-da80-4629-803f-13f60e055084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250', 'volume_name': 'volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2577580-4772-48da-80c7-02e97bf6e59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2577580-4772-48da-80c7-02e97bf6e59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb50ce94-5f0a-4a37-b1a1-e30e0c71373b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:11 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Volume 1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250', 'volume_size': 1}
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:11 devstack sudo[84149]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7 1G" returned: 0 in 1.560s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-509cf519-59ab-4db0-8f6e-7f957501620c -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:11 devstack sudo[84208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-509cf519-59ab-4db0-8f6e-7f957501620c -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7
Apr 27 15:08:11 devstack sudo[84208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:11 devstack sudo[84208]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-509cf519-59ab-4db0-8f6e-7f957501620c -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7" returned: 0 in 0.534s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:11 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7 is being set with open permissions: ugo+rw: NotImplementedError
Apr 27 15:08:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:11 devstack sudo[84215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7
Apr 27 15:08:11 devstack sudo[84215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:12 devstack sudo[84215]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7" returned: 0 in 0.501s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:12 devstack sudo[84219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.info
Apr 27 15:08:12 devstack sudo[84219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:12 devstack sudo[84219]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.info" returned: 0 in 0.516s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:12 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 27 15:08:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:13 devstack sudo[84222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.info
Apr 27 15:08:13 devstack sudo[84222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:13 devstack sudo[84222]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.info" returned: 0 in 0.531s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.727s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.220s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=98656f98-7dc1-4e2b-9f83-12ea996868b1,created_at=2026-04-27T13:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1225320035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=98656f98-7dc1-4e2b-9f83-12ea996868b1,host='devstack@QuobyteHD#QuobyteHD',id=1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733041db637c49a3b0a88b1df1ab1648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:08:11Z,use_quota=True,user_id='a76a8360501d4fafbb5eb54e504cd100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed42f1af-4932-476c-b130-409662cdbe20),volume_type_id=ed42f1af-4932-476c-b130-409662cdbe20)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:08:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Creating volume 1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:08:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:08:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:08:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:08:13 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:08:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:13 devstack sudo[84227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 1073741824
Apr 27 15:08:13 devstack sudo[84227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:13 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-50aee4ea-677e-4fcd-be7c-a6ba73973ccc tempest-GroupSnapshotsTest-559111101 None] group_snapshot eb28d115-ead8-4be1-9345-9876301e306c: created successfully
Apr 27 15:08:14 devstack sudo[84227]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 1073741824" returned: 0 in 0.627s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:14 devstack sudo[84233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250
Apr 27 15:08:14 devstack sudo[84233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:14 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] group_snapshot eb28d115-ead8-4be1-9345-9876301e306c: deleting
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] group_snapshot eb28d115-ead8-4be1-9345-9876301e306c: deleting {{(pid=81538) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-ac4891b7-06de-42e0-8154-8a58dc2c87f8" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-ac4891b7-06de-42e0-8154-8a58dc2c87f8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-9341ab74-84ca-458d-8c3c-059e7d2bdeef" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-9341ab74-84ca-458d-8c3c-059e7d2bdeef" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Deleting offline snapshot 9341ab74-84ca-458d-8c3c-059e7d2bdeef of volume ac4891b7-06de-42e0-8154-8a58dc2c87f8 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] snapshot_file for this snap is: volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[163379f9-8c67-46ae-a464-4153e559f2b5]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:14 devstack sudo[84233]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250" returned: 0 in 0.534s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:14 devstack sudo[84236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef
Apr 27 15:08:14 devstack sudo[84236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb50ce94-5f0a-4a37-b1a1-e30e0c71373b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55aabc01-0523-4f37-a928-f6621bd42e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:14 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Volume volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 (1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250): created successfully
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55aabc01-0523-4f37-a928-f6621bd42e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Flow 'volume_create_manager' (6f4efdd1-b913-4ba1-a46e-bbe4ea7de9e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:08:14 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b66c49c2-1d24-48b8-8f72-bbe15d8f0cea tempest-GroupSnapshotsV319Test-1901591764 None] Created volume successfully.
Apr 27 15:08:15 devstack sudo[84236]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef" returned: 0 in 0.624s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:08:15 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d95d05-0429-41d4-987e-1320def5e7b4]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:15 devstack sudo[84247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8
Apr 27 15:08:15 devstack sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:15 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] GroupSnapshot b2270c5a-2143-49c2-81af-d59db49d8790: creating.
Apr 27 15:08:15 devstack sudo[84247]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] Group snapshot b2270c5a-2143-49c2-81af-d59db49d8790: creating. {{(pid=81538) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 27 15:08:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8" returned: 0 in 0.632s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:15 devstack sudo[84260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef
Apr 27 15:08:16 devstack sudo[84260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] Creating offline snapshot 27253448-29c4-4d3d-b7ec-9c8d38edf763 of volume 1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:08:16 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4dcc36-da1d-475a-902b-ae9354d6af58]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:16 devstack sudo[84262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250
Apr 27 15:08:16 devstack sudo[84262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:16 devstack sudo[84262]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250" returned: 0 in 0.699s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:16 devstack sudo[84302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763 1G
Apr 27 15:08:16 devstack sudo[84302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:16 devstack sudo[84260]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef" returned: 0 in 0.928s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:16 devstack sudo[84305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef
Apr 27 15:08:16 devstack sudo[84305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:17 devstack sudo[84305]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8.9341ab74-84ca-458d-8c3c-059e7d2bdeef" returned: 0 in 0.823s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:17 devstack sudo[84302]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-9341ab74-84ca-458d-8c3c-059e7d2bdeef" released by "_delete_snapshot" :: held 3.158s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:08:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763 1G" returned: 0 in 1.058s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-ac4891b7-06de-42e0-8154-8a58dc2c87f8" released by "delete_snapshot" :: held 3.210s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:08:17 devstack sudo[84321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763
Apr 27 15:08:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-509cf519-59ab-4db0-8f6e-7f957501620c" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:08:17 devstack sudo[84321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-509cf519-59ab-4db0-8f6e-7f957501620c" acquired by "delete_snapshot" :: waited 0.114s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:08:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-af4bc98e-7197-4e36-b597-05e34ad455c7" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:08:18 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-af4bc98e-7197-4e36-b597-05e34ad455c7" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:08:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Deleting offline snapshot af4bc98e-7197-4e36-b597-05e34ad455c7 of volume 509cf519-59ab-4db0-8f6e-7f957501620c {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:08:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] snapshot_file for this snap is: volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:08:18 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4214642-24b5-48cd-ad9a-474ec0e44353]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:18 devstack sudo[84342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7
Apr 27 15:08:18 devstack sudo[84342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:18 devstack sudo[84321]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763" returned: 0 in 0.908s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:18 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763 is being set with open permissions: ugo+rw: NotImplementedError
Apr 27 15:08:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:18 devstack sudo[84352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763
Apr 27 15:08:18 devstack sudo[84352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:18 devstack sudo[84342]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7" returned: 0 in 0.686s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-509cf519-59ab-4db0-8f6e-7f957501620c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:08:18 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ca3c72-53c8-42ab-a827-b52e75cb5db3]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:18 devstack sudo[84354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c
Apr 27 15:08:18 devstack sudo[84354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:19 devstack sudo[84352]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763" returned: 0 in 0.604s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:19 devstack sudo[84357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.info
Apr 27 15:08:19 devstack sudo[84357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:19 devstack sudo[84354]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c" returned: 0 in 0.961s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:19 devstack sudo[84362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7
Apr 27 15:08:19 devstack sudo[84362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Flow 'volume_create_manager' (a2a3c58e-0ca7-47ba-9c00-ad9a290b8940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbbefcb-b38f-4f7b-ae4c-4b2b740ac7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbbefcb-b38f-4f7b-ae4c-4b2b740ac7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1818053076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89bc9f26-fcfb-4fb1-8875-5084a3742f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a136f52f5f5c4db1b7d837ace8e48f35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:08:20Z,use_quota=True,user_id='2477b0bf10504deabb5ad7791c8aed7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3863c4a-e5d0-4752-88a8-c069a6ebf0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3863c4a-e5d0-4752-88a8-c069a6ebf0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee8bf48-8552-464d-980a-2419cb55a4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee8bf48-8552-464d-980a-2419cb55a4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89bc9f26-fcfb-4fb1-8875-5084a3742f31', 'volume_name': 'volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f2f928a-219a-4d45-96ed-9daadf36f98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f2f928a-219a-4d45-96ed-9daadf36f98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6e7ad9-6885-4afc-819b-0bb78fd6d142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:20 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Volume 89bc9f26-fcfb-4fb1-8875-5084a3742f31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31', 'volume_size': 1}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:20 devstack sudo[84357]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.info" returned: 0 in 1.004s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:20 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:20 devstack sudo[84374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.info
Apr 27 15:08:20 devstack sudo[84374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:20 devstack sudo[84362]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7" returned: 0 in 0.767s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:20 devstack sudo[84381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7
Apr 27 15:08:20 devstack sudo[84381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:20 devstack sudo[84374]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.info" returned: 0 in 0.529s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.961s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.671s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1818053076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89bc9f26-fcfb-4fb1-8875-5084a3742f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a136f52f5f5c4db1b7d837ace8e48f35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:08:20Z,use_quota=True,user_id='2477b0bf10504deabb5ad7791c8aed7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Creating volume 89bc9f26-fcfb-4fb1-8875-5084a3742f31 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:08:20 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:08:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:21 devstack sudo[84390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31 1073741824
Apr 27 15:08:21 devstack sudo[84390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:21 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f690a6c2-b647-4ad4-803b-5622831730b7 tempest-GroupSnapshotsV319Test-1901591764 None] group_snapshot b2270c5a-2143-49c2-81af-d59db49d8790: created successfully
Apr 27 15:08:21 devstack sudo[84381]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c.af4bc98e-7197-4e36-b597-05e34ad455c7" returned: 0 in 0.561s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-af4bc98e-7197-4e36-b597-05e34ad455c7" released by "_delete_snapshot" :: held 3.163s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:08:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-509cf519-59ab-4db0-8f6e-7f957501620c" released by "delete_snapshot" :: held 3.225s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:08:21 devstack cinder-volume[81538]: WARNING cinder.quota [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-649572398 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-649572398, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:08:21 devstack cinder-volume[81538]: WARNING cinder.quota [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-649572398 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-649572398, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:08:21 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Created reservations ['877f6927-e233-40eb-8fbc-216a9ab32cea', 'cd84faeb-3d2e-4135-ae79-523ceeb046d1', '72dd0cc3-16c7-4763-a725-69cefd459a36', '2f6d2423-d16f-4c18-a389-0b72d5bad1d4'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:08:21 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] Created reservations ['2e41cf2e-1817-4b4f-901c-66e058d4ea5d', '54d2006d-468d-4f93-80c5-3912488ef7d4', '4bb10d6e-2cca-4df6-b0f7-d8db3b41f507', 'a54a2cd4-1310-47f3-82e9-bb8367c2138b'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:08:21 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-fc3d399b-c9a3-4b58-84b5-3bf872ff6e4e tempest-GroupSnapshotsTest-559111101 None] group_snapshot eb28d115-ead8-4be1-9345-9876301e306c: deleted successfully
Apr 27 15:08:21 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] group_snapshot b2270c5a-2143-49c2-81af-d59db49d8790: deleting
Apr 27 15:08:21 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] group_snapshot b2270c5a-2143-49c2-81af-d59db49d8790: deleting {{(pid=81538) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 27 15:08:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Acquiring lock "cinder-quobyte-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:08:21 devstack sudo[84390]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31 1073741824" returned: 0 in 0.945s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Lock "cinder-quobyte-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250" acquired by "delete_snapshot" :: waited 0.044s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:08:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Acquiring lock "cinder-quobyte-27253448-29c4-4d3d-b7ec-9c8d38edf763" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:08:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Lock "cinder-quobyte-27253448-29c4-4d3d-b7ec-9c8d38edf763" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:08:21 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Deleting offline snapshot 27253448-29c4-4d3d-b7ec-9c8d38edf763 of volume 1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] snapshot_file for this snap is: volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa6e5e7-f29d-43fb-b6ee-7b8e9f5e574d]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:22 devstack sudo[84395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31
Apr 27 15:08:22 devstack sudo[84395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:22 devstack sudo[84396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763
Apr 27 15:08:22 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:22 devstack sudo[84395]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31" returned: 0 in 0.734s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6e7ad9-6885-4afc-819b-0bb78fd6d142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a649c690-d281-4ea4-8c39-6ce5e2652fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-509cf519-59ab-4db0-8f6e-7f957501620c" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:08:22 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Volume volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31 (89bc9f26-fcfb-4fb1-8875-5084a3742f31): created successfully
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a649c690-d281-4ea4-8c39-6ce5e2652fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Flow 'volume_create_manager' (a2a3c58e-0ca7-47ba-9c00-ad9a290b8940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:08:22 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:22 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-304c8d4c-e9d2-48a3-9450-ddaa3a63ae6e tempest-ServerRescueNegativeTestJSON-1054006647 None] Created volume successfully.
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763" returned: 0 in 0.813s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-509cf519-59ab-4db0-8f6e-7f957501620c" acquired by "delete_volume" :: waited 0.061s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[87072433-55c5-49fc-8bfa-99db4f7ea712]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd7055f-8228-497f-8855-980be72f611f]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:22 devstack sudo[84403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c
Apr 27 15:08:22 devstack sudo[84403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:23 devstack sudo[84404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250
Apr 27 15:08:23 devstack sudo[84404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:23 devstack sudo[84403]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c" returned: 0 in 0.656s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:23 devstack sudo[84404]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250" returned: 0 in 0.688s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:23 devstack sudo[84416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c
Apr 27 15:08:23 devstack sudo[84416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:23 devstack sudo[84417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763
Apr 27 15:08:23 devstack sudo[84417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:24 devstack sudo[84416]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-509cf519-59ab-4db0-8f6e-7f957501620c" returned: 0 in 0.705s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-509cf519-59ab-4db0-8f6e-7f957501620c" released by "delete_volume" :: held 1.461s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:08:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-ac4891b7-06de-42e0-8154-8a58dc2c87f8" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:08:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-ac4891b7-06de-42e0-8154-8a58dc2c87f8" acquired by "delete_volume" :: waited 0.032s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:08:24 devstack sudo[84417]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763" returned: 0 in 0.776s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:24 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9fc493-0860-4fae-bb95-bbd3ab6f5b08]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:24 devstack sudo[84448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763
Apr 27 15:08:24 devstack sudo[84448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:24 devstack sudo[84449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8
Apr 27 15:08:24 devstack sudo[84449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:24 devstack sudo[84448]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250.27253448-29c4-4d3d-b7ec-9c8d38edf763" returned: 0 in 0.464s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Lock "cinder-quobyte-27253448-29c4-4d3d-b7ec-9c8d38edf763" released by "_delete_snapshot" :: held 2.935s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:08:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Lock "cinder-quobyte-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250" released by "delete_snapshot" :: held 2.971s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:08:25 devstack cinder-volume[81538]: WARNING cinder.quota [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1074419756 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1074419756, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:08:25 devstack cinder-volume[81538]: WARNING cinder.quota [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1074419756 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1074419756, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:08:25 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] Created reservations ['643cfcf7-53ba-4970-a8e1-9f379d8f8e71', '9d320aac-684c-455a-ae82-88ad0c661ab9', '763b20b8-3857-4288-b834-d00b8e4771da', 'ae44f7c7-8e31-46a0-b4cc-768b765c4b47'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:08:25 devstack sudo[84449]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8" returned: 0 in 0.875s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:25 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-55b7ac72-c1fe-4b50-ac94-d1f204ca83ec tempest-GroupSnapshotsV319Test-1901591764 None] group_snapshot b2270c5a-2143-49c2-81af-d59db49d8790: deleted successfully
Apr 27 15:08:25 devstack sudo[84459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8
Apr 27 15:08:25 devstack sudo[84459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:25 devstack sudo[84459]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ac4891b7-06de-42e0-8154-8a58dc2c87f8" returned: 0 in 0.546s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-ac4891b7-06de-42e0-8154-8a58dc2c87f8" released by "delete_volume" :: held 1.502s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:08:25 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Created reservations ['c9032a2e-838d-48e4-8a9f-e460b78533f1'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:08:25 devstack cinder-volume[81538]: WARNING cinder.quota [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-649572398 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-649572398, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:08:25 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Created reservations ['af1175fa-804d-45a7-a981-6c47f4a0a50c', 'c2dd9534-fd99-45ca-878e-fbe3468b0a92', '5a39e111-b161-4c87-b441-380695736586', 'e9887fa3-818c-4986-afc2-3534599382d3'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:08:26 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Created reservations ['df6dd05d-6b6e-4ba7-bfc0-a29c93570a95', 'c34cad3f-6d7b-4fa5-ac73-3844d11c9c30', '8387af19-2a05-4d3b-a9f6-b634fc7106df', '6dc5c902-7bed-49b3-9b1d-b0606ce5f618'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:08:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:26 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:08:26 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:08:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:26 devstack sudo[84473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:08:26 devstack sudo[84473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Acquiring lock "cinder-quobyte-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:08:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Lock "cinder-quobyte-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250" acquired by "delete_volume" :: waited 0.082s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:08:27 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f18252-43e2-48e4-8a2e-9178e00abd4a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:27 devstack sudo[84509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250
Apr 27 15:08:27 devstack sudo[84509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:27 devstack sudo[84473]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 1.542s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:27 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:08:27 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-98841fd6-28dc-40df-a346-bcb053e5004c tempest-GroupSnapshotsTest-559111101 None] Delete group completed successfully.
Apr 27 15:08:27 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-be445e5b-bc4f-47e1-82c4-bb39840af8c2 tempest-GroupSnapshotsTest-559111101 None] Group tempest-GroupSnapshotsTest-Group-1111271498: creating
Apr 27 15:08:27 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-be445e5b-bc4f-47e1-82c4-bb39840af8c2 tempest-GroupSnapshotsTest-559111101 None] Group tempest-GroupSnapshotsTest-Group-1111271498: created successfully
Apr 27 15:08:27 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-be445e5b-bc4f-47e1-82c4-bb39840af8c2 tempest-GroupSnapshotsTest-559111101 None] Create group completed successfully.
Apr 27 15:08:28 devstack sudo[84509]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250" returned: 0 in 1.273s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:28 devstack sudo[84540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250
Apr 27 15:08:28 devstack sudo[84540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:29 devstack sudo[84540]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250" returned: 0 in 1.095s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:29 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Lock "cinder-quobyte-1ac9c9e6-b691-4fa3-9faa-cc73fe3a2250" released by "delete_volume" :: held 2.608s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:08:29 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Created reservations ['5a953085-bf8f-4e14-8e94-48a521305693'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:08:29 devstack cinder-volume[81538]: WARNING cinder.quota [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1074419756 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1074419756, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Created reservations ['29809575-cfc6-4ddf-a8ef-ec271d78f396', '7c3bac40-a4ac-4b17-b456-a7e1823cbf5d', '9feb9b28-16f4-4770-9a65-1dc2d301dcbb', '686de6f1-ba98-4e44-b8ea-72c43479e447'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Flow 'volume_create_manager' (0928001a-ee63-4c03-b68f-3eeff5dc6e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1ad706-2c71-4eb7-aa17-626f91de8020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1ad706-2c71-4eb7-aa17-626f91de8020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1666812493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1858220d-711c-4a86-aa7d-b0ae5c088c20,host='devstack@QuobyteHD#QuobyteHD',id=076d8eea-aac0-4bad-94cc-540f0fda703c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='981ef9b32ff646ea9f221fa8673da2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:08:30Z,use_quota=True,user_id='f3683e54b4fb492cb60f9c1214e2eacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a38b42d3-5479-448f-ad2c-a33a604a4a9c),volume_type_id=a38b42d3-5479-448f-ad2c-a33a604a4a9c)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d591182-a60d-4683-9a24-5aa7c10d0664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d591182-a60d-4683-9a24-5aa7c10d0664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4a5a76-d001-49ff-a55a-84dbbc8510e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4a5a76-d001-49ff-a55a-84dbbc8510e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '076d8eea-aac0-4bad-94cc-540f0fda703c', 'volume_name': 'volume-076d8eea-aac0-4bad-94cc-540f0fda703c', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455fc241-c53a-4698-8049-aa7685019175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455fc241-c53a-4698-8049-aa7685019175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6e701e-1e33-4c9b-898c-83d592857ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:30 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Volume 076d8eea-aac0-4bad-94cc-540f0fda703c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-076d8eea-aac0-4bad-94cc-540f0fda703c', 'volume_size': 1}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1858220d-711c-4a86-aa7d-b0ae5c088c20,created_at=2026-04-27T13:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1666812493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1858220d-711c-4a86-aa7d-b0ae5c088c20,host='devstack@QuobyteHD#QuobyteHD',id=076d8eea-aac0-4bad-94cc-540f0fda703c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='981ef9b32ff646ea9f221fa8673da2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:08:30Z,use_quota=True,user_id='f3683e54b4fb492cb60f9c1214e2eacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a38b42d3-5479-448f-ad2c-a33a604a4a9c),volume_type_id=a38b42d3-5479-448f-ad2c-a33a604a4a9c)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Creating volume 076d8eea-aac0-4bad-94cc-540f0fda703c {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:08:30 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:30 devstack sudo[84589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c 1073741824
Apr 27 15:08:30 devstack sudo[84589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:30 devstack sudo[84591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:08:30 devstack sudo[84591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:31 devstack sudo[84589]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c 1073741824" returned: 0 in 1.078s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:31 devstack sudo[84597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c
Apr 27 15:08:31 devstack sudo[84597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:31 devstack sudo[84591]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.955s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:31 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:08:31 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-60bf2017-7356-4353-b7b3-a1a6f6aca8be tempest-GroupSnapshotsV319Test-1901591764 None] Delete group completed successfully.
Apr 27 15:08:32 devstack sudo[84597]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c" returned: 0 in 0.762s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:08:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6e701e-1e33-4c9b-898c-83d592857ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-076d8eea-aac0-4bad-94cc-540f0fda703c', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47c5910-6b44-4e62-8839-e476dc7b446e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:08:32 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Volume volume-076d8eea-aac0-4bad-94cc-540f0fda703c (076d8eea-aac0-4bad-94cc-540f0fda703c): created successfully
Apr 27 15:08:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47c5910-6b44-4e62-8839-e476dc7b446e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:08:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Flow 'volume_create_manager' (0928001a-ee63-4c03-b68f-3eeff5dc6e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:08:32 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-9314404d-49cc-4fce-9c4f-8659bb8d94f9 tempest-GroupSnapshotsTest-559111101 None] Created volume successfully.
Apr 27 15:08:32 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] GroupSnapshot e6e5a434-ff8f-4da4-9352-de7c380c7b23: creating.
Apr 27 15:08:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] Group snapshot e6e5a434-ff8f-4da4-9352-de7c380c7b23: creating. {{(pid=81538) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 27 15:08:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] Creating offline snapshot e890f0d1-729f-494f-887d-1c003bcd46bc of volume 076d8eea-aac0-4bad-94cc-540f0fda703c {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:08:32 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef23557-8489-45bb-b632-c0331b1d5570]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:32 devstack sudo[84603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c
Apr 27 15:08:32 devstack sudo[84603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:33 devstack sudo[84603]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c" returned: 0 in 0.782s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:33 devstack sudo[84648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc 1G
Apr 27 15:08:33 devstack sudo[84648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:34 devstack sudo[84648]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc 1G" returned: 0 in 0.883s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-076d8eea-aac0-4bad-94cc-540f0fda703c -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:34 devstack sudo[84666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-076d8eea-aac0-4bad-94cc-540f0fda703c -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc
Apr 27 15:08:34 devstack sudo[84666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:34 devstack sudo[84666]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-076d8eea-aac0-4bad-94cc-540f0fda703c -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc" returned: 0 in 0.545s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:34 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc is being set with open permissions: ugo+rw: NotImplementedError
Apr 27 15:08:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:34 devstack sudo[84678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc
Apr 27 15:08:34 devstack sudo[84678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:35 devstack sudo[84678]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc" returned: 0 in 0.632s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:35 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=122,cinder:UPDATE=122,cinder:INSERT=39,cinder:DELETE=4 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:08:35 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:UPDATE=133,cinder:SELECT=143,cinder:INSERT=20,cinder:DELETE=5 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:08:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:35 devstack sudo[84708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.info
Apr 27 15:08:35 devstack sudo[84708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:36 devstack sudo[84708]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.info" returned: 0 in 0.608s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:36 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 27 15:08:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:36 devstack sudo[84718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.info
Apr 27 15:08:36 devstack sudo[84718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:36 devstack sudo[84718]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.info" returned: 0 in 0.576s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.185s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:36 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-80e0919e-40c8-4517-9b05-e28b8a470a7a tempest-GroupSnapshotsTest-559111101 None] group_snapshot e6e5a434-ff8f-4da4-9352-de7c380c7b23: created successfully
Apr 27 15:08:38 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] group_snapshot e6e5a434-ff8f-4da4-9352-de7c380c7b23: deleting
Apr 27 15:08:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] group_snapshot e6e5a434-ff8f-4da4-9352-de7c380c7b23: deleting {{(pid=81538) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 27 15:08:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-076d8eea-aac0-4bad-94cc-540f0fda703c" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:08:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-076d8eea-aac0-4bad-94cc-540f0fda703c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:08:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-e890f0d1-729f-494f-887d-1c003bcd46bc" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:08:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-e890f0d1-729f-494f-887d-1c003bcd46bc" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:08:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Deleting offline snapshot e890f0d1-729f-494f-887d-1c003bcd46bc of volume 076d8eea-aac0-4bad-94cc-540f0fda703c {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:08:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] snapshot_file for this snap is: volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:08:38 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[331c33c4-982f-41ec-80db-091d8c9aedd2]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:38 devstack sudo[84767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc
Apr 27 15:08:38 devstack sudo[84767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:39 devstack sudo[84767]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc" returned: 0 in 1.095s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-076d8eea-aac0-4bad-94cc-540f0fda703c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:08:39 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[169e060c-0205-4aa9-bded-dd134d9aa7c0]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:39 devstack sudo[84774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c
Apr 27 15:08:39 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:40 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c" returned: 0 in 0.725s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:40 devstack sudo[84780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc
Apr 27 15:08:40 devstack sudo[84780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:41 devstack sudo[84780]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc" returned: 0 in 1.083s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:41 devstack sudo[84788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc
Apr 27 15:08:41 devstack sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:42 devstack sudo[84788]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c.e890f0d1-729f-494f-887d-1c003bcd46bc" returned: 0 in 0.558s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-e890f0d1-729f-494f-887d-1c003bcd46bc" released by "_delete_snapshot" :: held 3.674s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:08:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-076d8eea-aac0-4bad-94cc-540f0fda703c" released by "delete_snapshot" :: held 3.740s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:08:42 devstack cinder-volume[81538]: WARNING cinder.quota [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1495283825 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1495283825, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:08:42 devstack cinder-volume[81538]: WARNING cinder.quota [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1495283825 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1495283825, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:08:42 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] Created reservations ['110e54eb-1149-4c38-9a02-bf7c8cc49dc1', '87dbf59b-581d-4f80-946d-e273fb0f8323', 'e65321ff-6839-4d56-91c1-30119e7904ff', '72a0020e-f531-42da-8581-bbac1dce15bb'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:08:42 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-0415f9d6-3310-4de2-be25-d34276b27862 tempest-GroupSnapshotsTest-559111101 None] group_snapshot e6e5a434-ff8f-4da4-9352-de7c380c7b23: deleted successfully
Apr 27 15:08:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "cinder-quobyte-076d8eea-aac0-4bad-94cc-540f0fda703c" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:08:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-076d8eea-aac0-4bad-94cc-540f0fda703c" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:08:43 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f56c293-26a6-42c3-a97e-965b7c1f8773]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:43 devstack sudo[84834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c
Apr 27 15:08:43 devstack sudo[84834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:44 devstack sudo[84834]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c" returned: 0 in 0.671s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:44 devstack sudo[84846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c
Apr 27 15:08:44 devstack sudo[84846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:44 devstack sudo[84846]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-076d8eea-aac0-4bad-94cc-540f0fda703c" returned: 0 in 0.566s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Lock "cinder-quobyte-076d8eea-aac0-4bad-94cc-540f0fda703c" released by "delete_volume" :: held 1.309s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:08:44 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Created reservations ['88c40d2b-0a8d-4e26-8d1c-79299d8a2e30'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:08:44 devstack cinder-volume[81538]: WARNING cinder.quota [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1495283825 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1495283825, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:08:44 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Created reservations ['128c8728-fbcb-41da-a82c-91e85cfd2cae', 'a0ee0c05-f030-48ce-a0b2-d0b69e3f96a3', '821c8933-9fba-48a5-8100-46963c8c8b52', '12406b0f-02f0-4563-a2fc-34d96a4e4325'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:08:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:08:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:08:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:44 devstack sudo[84857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:08:44 devstack sudo[84857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:45 devstack sudo[84857]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.657s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:45 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:08:45 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-709a3bd7-1639-44ef-9b97-f5ba3d83d3ee tempest-GroupSnapshotsTest-559111101 None] Delete group completed successfully.
Apr 27 15:08:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Acquiring lock "cinder-89bc9f26-fcfb-4fb1-8875-5084a3742f31-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:08:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Lock "cinder-89bc9f26-fcfb-4fb1-8875-5084a3742f31-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:08:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Acquiring lock "cinder-quobyte-89bc9f26-fcfb-4fb1-8875-5084a3742f31" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:08:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Lock "cinder-quobyte-89bc9f26-fcfb-4fb1-8875-5084a3742f31" acquired by "delete_volume" :: waited 0.039s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:08:48 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[82047ae5-1c0d-41d5-879f-53e6e8e7b3e9]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:08:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:48 devstack sudo[84898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31
Apr 27 15:08:48 devstack sudo[84898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:48 devstack cinder-volume[81538]: DEBUG oslo_service.periodic_task [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81538) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:08:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:08:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:08:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:48 devstack sudo[84909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:08:48 devstack sudo[84909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:49 devstack sudo[84898]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31" returned: 0 in 1.438s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:49 devstack sudo[84919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31
Apr 27 15:08:49 devstack sudo[84919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:49 devstack sudo[84909]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 1.075s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:49 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:08:50 devstack sudo[84919]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89bc9f26-fcfb-4fb1-8875-5084a3742f31" returned: 0 in 0.743s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Lock "cinder-quobyte-89bc9f26-fcfb-4fb1-8875-5084a3742f31" released by "delete_volume" :: held 2.249s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:08:50 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Created reservations ['f7fc818e-18d7-4675-8fbf-73f00b70ff98', '23d6d616-2441-43af-9eed-5a0835b6cc9e', '3d3398a3-2378-4c38-9913-158c164b0f8a', 'd43441e7-dda5-456d-9b4e-41f1198b73aa'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:08:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:08:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:08:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:08:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:08:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:08:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:08:50 devstack sudo[84923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:08:50 devstack sudo[84923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:08:51 devstack sudo[84923]: pam_unix(sudo:session): session closed for user root
Apr 27 15:08:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.761s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:08:51 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:08:51 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Deleted volume successfully.
Apr 27 15:08:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-48f9e1e9-d5bc-4879-9631-6fffe91616e3 tempest-ServerRescueNegativeTestJSON-1054006647 None] Lock "cinder-89bc9f26-fcfb-4fb1-8875-5084a3742f31-delete_volume" released by "delete_volume" :: held 3.609s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:00 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=23,cinder:UPDATE=27,cinder:INSERT=9 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:09:01 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=26,cinder:INSERT=5,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:09:03 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5c9cc3d4-d927-4588-a4d0-cb38836f8247 tempest-GroupsV314Test-139484149 None] Group tempest-GroupsV314Test-Group-643230486: creating
Apr 27 15:09:03 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5c9cc3d4-d927-4588-a4d0-cb38836f8247 tempest-GroupsV314Test-139484149 None] Group tempest-GroupsV314Test-Group-643230486: created successfully
Apr 27 15:09:03 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5c9cc3d4-d927-4588-a4d0-cb38836f8247 tempest-GroupsV314Test-139484149 None] Create group completed successfully.
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Flow 'volume_create_manager' (6a654be3-2526-4f72-8e34-e9f3a0a5b9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d93eb10c-4f98-4ba0-8358-15d7dc269677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d93eb10c-4f98-4ba0-8358-15d7dc269677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-216159220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=24ddf5ad-f45e-4425-8ccc-5cdcb21499a2,host='devstack@QuobyteHD#QuobyteHD',id=ae39ae55-38da-4fbe-8289-8bece7f5a8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbbd5f7cece4c26a216543509c00c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:06Z,use_quota=True,user_id='75532ec565264ffb84ef29f4081c33b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02fa2a36-fa3a-4770-980e-2e34334038ac),volume_type_id=02fa2a36-fa3a-4770-980e-2e34334038ac)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11cd320-69d2-462d-ade1-6e32f9c8e745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11cd320-69d2-462d-ade1-6e32f9c8e745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7f02b2-34c2-4e9e-a673-19c0c25bbf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7f02b2-34c2-4e9e-a673-19c0c25bbf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae39ae55-38da-4fbe-8289-8bece7f5a8d3', 'volume_name': 'volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e7e201-c586-4e17-b3c1-33dfdc674b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e7e201-c586-4e17-b3c1-33dfdc674b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5476e18-6819-4ec0-9a4f-bb6501fcada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:05 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Volume ae39ae55-38da-4fbe-8289-8bece7f5a8d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3', 'volume_size': 1}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=24ddf5ad-f45e-4425-8ccc-5cdcb21499a2,created_at=2026-04-27T13:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-216159220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=24ddf5ad-f45e-4425-8ccc-5cdcb21499a2,host='devstack@QuobyteHD#QuobyteHD',id=ae39ae55-38da-4fbe-8289-8bece7f5a8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dbbd5f7cece4c26a216543509c00c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:06Z,use_quota=True,user_id='75532ec565264ffb84ef29f4081c33b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02fa2a36-fa3a-4770-980e-2e34334038ac),volume_type_id=02fa2a36-fa3a-4770-980e-2e34334038ac)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Creating volume ae39ae55-38da-4fbe-8289-8bece7f5a8d3 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:09:05 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:09:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:05 devstack sudo[85105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 1073741824
Apr 27 15:09:05 devstack sudo[85105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:06 devstack sudo[85105]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 1073741824" returned: 0 in 0.979s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:06 devstack sudo[85111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3
Apr 27 15:09:06 devstack sudo[85111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:07 devstack sudo[85111]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3" returned: 0 in 0.539s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5476e18-6819-4ec0-9a4f-bb6501fcada0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fa7923-dc25-4054-929f-de7b1ffc73d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:07 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Volume volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 (ae39ae55-38da-4fbe-8289-8bece7f5a8d3): created successfully
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fa7923-dc25-4054-929f-de7b1ffc73d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Flow 'volume_create_manager' (6a654be3-2526-4f72-8e34-e9f3a0a5b9bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:07 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-125fb888-33f8-4be3-bbeb-c8dfb4fced33 tempest-GroupsV314Test-139484149 None] Created volume successfully.
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Flow 'volume_create_manager' (a154dff7-9c3d-4215-b4dc-2593e47316ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0876f6a8-aaf1-4727-bbb7-dcec3c9f65c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0876f6a8-aaf1-4727-bbb7-dcec3c9f65c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1250210224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29823f51-d841-41f0-b393-8940caba714f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c02be3b10f04f2daf600dcda5605af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:07Z,use_quota=True,user_id='7983a4357cfe432d8f3b1ab3bf573eea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77627a3e-4184-4847-a445-3e83d2afd974),volume_type_id=77627a3e-4184-4847-a445-3e83d2afd974)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130c7bf0-3864-4f42-a611-4ac87392bb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130c7bf0-3864-4f42-a611-4ac87392bb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbad3358-f5c9-4c4c-aa5b-75865ca64eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbad3358-f5c9-4c4c-aa5b-75865ca64eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29823f51-d841-41f0-b393-8940caba714f', 'volume_name': 'volume-29823f51-d841-41f0-b393-8940caba714f', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd865a6-db4a-4809-99ac-69eb0b1c78a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd865a6-db4a-4809-99ac-69eb0b1c78a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1140abf-ac87-43e5-9f00-46735daddaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:07 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Volume 29823f51-d841-41f0-b393-8940caba714f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29823f51-d841-41f0-b393-8940caba714f', 'volume_size': 1}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1250210224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29823f51-d841-41f0-b393-8940caba714f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c02be3b10f04f2daf600dcda5605af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:07Z,use_quota=True,user_id='7983a4357cfe432d8f3b1ab3bf573eea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77627a3e-4184-4847-a445-3e83d2afd974),volume_type_id=77627a3e-4184-4847-a445-3e83d2afd974)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Creating volume 29823f51-d841-41f0-b393-8940caba714f {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:09:07 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:09:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-29823f51-d841-41f0-b393-8940caba714f 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:07 devstack sudo[85114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-29823f51-d841-41f0-b393-8940caba714f 1073741824
Apr 27 15:09:07 devstack sudo[85114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:08 devstack sudo[85114]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-29823f51-d841-41f0-b393-8940caba714f 1073741824" returned: 0 in 0.731s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-29823f51-d841-41f0-b393-8940caba714f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:08 devstack sudo[85121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-29823f51-d841-41f0-b393-8940caba714f
Apr 27 15:09:08 devstack sudo[85121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:08 devstack sudo[85121]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-29823f51-d841-41f0-b393-8940caba714f" returned: 0 in 0.496s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:09:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1140abf-ac87-43e5-9f00-46735daddaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29823f51-d841-41f0-b393-8940caba714f', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dda61d4-0301-4576-bce6-d315015d89af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:08 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Volume volume-29823f51-d841-41f0-b393-8940caba714f (29823f51-d841-41f0-b393-8940caba714f): created successfully
Apr 27 15:09:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dda61d4-0301-4576-bce6-d315015d89af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Flow 'volume_create_manager' (a154dff7-9c3d-4215-b4dc-2593e47316ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:08 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-99015820-0c0e-4f74-badd-e82fac601f8d tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Created volume successfully.
Apr 27 15:09:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:08 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Cloning volume ae39ae55-38da-4fbe-8289-8bece7f5a8d3 to volume 45d6d67d-70d8-4095-ad1c-00444d78f7cd
Apr 27 15:09:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Creating offline snapshot 44a51584-df7c-4e62-a800-212419d49114 of volume ae39ae55-38da-4fbe-8289-8bece7f5a8d3 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:09:09 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cf58b8-2734-452e-8747-bf305982db7b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:09 devstack sudo[85145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3
Apr 27 15:09:09 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4f4267eb-cd9a-4289-9fb1-32dc7c25d0e0 tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4f4267eb-cd9a-4289-9fb1-32dc7c25d0e0 tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4f4267eb-cd9a-4289-9fb1-32dc7c25d0e0 tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4f4267eb-cd9a-4289-9fb1-32dc7c25d0e0 tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4f4267eb-cd9a-4289-9fb1-32dc7c25d0e0 tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4f4267eb-cd9a-4289-9fb1-32dc7c25d0e0 tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:10 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3" returned: 0 in 1.071s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:10 devstack sudo[85156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:09:10 devstack sudo[85156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:10 devstack sudo[85157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114 1G
Apr 27 15:09:10 devstack sudo[85157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:10 devstack sudo[85156]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4f4267eb-cd9a-4289-9fb1-32dc7c25d0e0 tempest-VolumeRetypeWithoutMigrationTest-701707901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.782s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:10 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-4f4267eb-cd9a-4289-9fb1-32dc7c25d0e0 tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:09:10 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-4f4267eb-cd9a-4289-9fb1-32dc7c25d0e0 tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Retype volume completed successfully.
Apr 27 15:09:11 devstack sudo[85157]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114 1G" returned: 0 in 1.180s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:11 devstack sudo[85165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114
Apr 27 15:09:11 devstack sudo[85165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Acquiring lock "cinder-29823f51-d841-41f0-b393-8940caba714f-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Lock "cinder-29823f51-d841-41f0-b393-8940caba714f-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Acquiring lock "cinder-quobyte-29823f51-d841-41f0-b393-8940caba714f" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Lock "cinder-quobyte-29823f51-d841-41f0-b393-8940caba714f" acquired by "delete_volume" :: waited 0.032s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:11 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1127fe55-5867-4505-85ae-474343449c2f]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-29823f51-d841-41f0-b393-8940caba714f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:12 devstack sudo[85170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-29823f51-d841-41f0-b393-8940caba714f
Apr 27 15:09:12 devstack sudo[85170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:12 devstack sudo[85165]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114" returned: 0 in 0.756s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:12 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114 is being set with open permissions: ugo+rw: NotImplementedError
Apr 27 15:09:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:12 devstack sudo[85172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114
Apr 27 15:09:12 devstack sudo[85172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:12 devstack sudo[85170]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-29823f51-d841-41f0-b393-8940caba714f" returned: 0 in 0.951s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-29823f51-d841-41f0-b393-8940caba714f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:12 devstack sudo[85199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-29823f51-d841-41f0-b393-8940caba714f
Apr 27 15:09:12 devstack sudo[85199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:12 devstack sudo[85172]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114" returned: 0 in 0.875s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:13 devstack sudo[85201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.info
Apr 27 15:09:13 devstack sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:13 devstack sudo[85199]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-29823f51-d841-41f0-b393-8940caba714f" returned: 0 in 0.719s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Lock "cinder-quobyte-29823f51-d841-41f0-b393-8940caba714f" released by "delete_volume" :: held 1.731s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:13 devstack cinder-volume[81538]: WARNING cinder.quota [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:09:13 devstack cinder-volume[81538]: WARNING cinder.quota [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:09:13 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Created reservations ['98c85a12-4a52-49b8-8fe9-4f3508d989c6', 'a6e59ed2-bea0-44e4-bac6-2a929bb95568', 'f700ca7e-fe5c-491b-b443-f4a993690dc5', '837e6ab7-f786-4837-bf0e-0a7b8240d9f8'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:09:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:13 devstack sudo[85201]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.info" returned: 0 in 0.787s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:13 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 27 15:09:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:13 devstack sudo[85205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:09:13 devstack sudo[85205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:13 devstack sudo[85206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.info
Apr 27 15:09:13 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:14 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.info" returned: 0 in 0.609s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:14 devstack sudo[85205]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Acquiring lock "cinder-quobyte-45d6d67d-70d8-4095-ad1c-00444d78f7cd" by "_copy_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.659s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:14 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:09:14 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Deleted volume successfully.
Apr 27 15:09:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Lock "cinder-quobyte-45d6d67d-70d8-4095-ad1c-00444d78f7cd" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] snapshot: 44a51584-df7c-4e62-a800-212419d49114, volume: 45d6d67d-70d8-4095-ad1c-00444d78f7cd,  {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 27 15:09:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b452f84d-9bc8-4e17-92b3-808af0d6c21c tempest-VolumeRetypeWithoutMigrationTest-701707901 None] Lock "cinder-29823f51-d841-41f0-b393-8940caba714f-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:14 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ca4ae4-f92d-46ad-bda4-ff780e3c49cb]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:14 devstack sudo[85212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114
Apr 27 15:09:14 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:15 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114" returned: 0 in 0.853s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:09:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 27 15:09:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Creating direct copy from snapshot {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 27 15:09:15 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc6321d-3fee-40ed-891f-49bb243a53a5]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:15 devstack sudo[85217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3
Apr 27 15:09:15 devstack sudo[85217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:16 devstack sudo[85217]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3" returned: 0 in 0.721s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:16 devstack cinder-volume[81538]: DEBUG cinder.utils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Path /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd not found in is_blk_device check {{(pid=81538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 27 15:09:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:16 devstack sudo[85224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd
Apr 27 15:09:16 devstack sudo[85224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:19 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:09:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Flow 'volume_create_manager' (574df171-9fc9-4bfe-8f30-10850e2bcaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3567af-9370-4a5b-97b9-843dcaf1c758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3567af-9370-4a5b-97b9-843dcaf1c758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2033555381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='945497138381498fa173992a61e2cb6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:19Z,use_quota=True,user_id='37f7b8e4de6840e5a76d8ea63683db0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83e5d246-5e35-49ee-81db-8a95b40d1fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83e5d246-5e35-49ee-81db-8a95b40d1fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81a0ad3-43ec-4fa1-8218-51fb0ffa30c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81a0ad3-43ec-4fa1-8218-51fb0ffa30c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d', 'volume_name': 'volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd6610c-2509-4208-b57f-a90d5cb3d6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd6610c-2509-4208-b57f-a90d5cb3d6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c05078b-a693-4a31-9ad3-c41799dee0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:19 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Volume c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d', 'volume_size': 1}
Apr 27 15:09:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:23 devstack sudo[85224]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd" returned: 0 in 7.064s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:23 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6dc1dc-57f7-4527-b750-271c6136d213]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:23 devstack sudo[85241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3
Apr 27 15:09:23 devstack sudo[85241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:24 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:09:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Flow 'volume_create_manager' (eb25cad2-b41c-4121-952b-c03d781cf8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe844b2-cb49-45d9-939f-bf6918e3e663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:24 devstack sudo[85241]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3" returned: 0 in 1.129s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe844b2-cb49-45d9-939f-bf6918e3e663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:24Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d362179-7c7f-4c77-bd46-ebe356ea1662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c0076463854a69a33466a2bd535c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:24Z,use_quota=True,user_id='55a2a8edb5754afc843101fd00a1bcda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983da417-fd21-41d4-8968-b628bc4d8095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983da417-fd21-41d4-8968-b628bc4d8095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a767f63d-413f-4be6-9a79-95c83b5e32c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:24 devstack cinder-volume[81538]: DEBUG cinder.image.glance [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Creating Keystone auth plugin from conf {{(pid=81538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 27 15:09:24 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3, size 1024.00 MB, duration 7.07 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:09:24 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Converted 1024.00 MB image at 144.93 MB/s
Apr 27 15:09:24 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd is being set with open permissions: ugo+rw: NotImplementedError
Apr 27 15:09:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:24 devstack sudo[85246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd
Apr 27 15:09:24 devstack sudo[85246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a767f63d-413f-4be6-9a79-95c83b5e32c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d362179-7c7f-4c77-bd46-ebe356ea1662', 'volume_name': 'volume-4d362179-7c7f-4c77-bd46-ebe356ea1662', 'volume_size': 1, 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8b5f6f0ff7c46c9826225de4a824e37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17408032-d085-42b0-a4db-fa0192e428de', 'created_at': datetime.datetime(2026, 4, 27, 13, 1, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 13, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17408032-d085-42b0-a4db-fa0192e428de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f59e4d14c70>}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4163d32e-c380-4f4c-aea9-9192ad466952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4163d32e-c380-4f4c-aea9-9192ad466952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df44e9d0-b808-4e72-9ff1-9f7c2475614d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:25 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Volume 4d362179-7c7f-4c77-bd46-ebe356ea1662: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d362179-7c7f-4c77-bd46-ebe356ea1662', 'volume_size': 1, 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8b5f6f0ff7c46c9826225de4a824e37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17408032-d085-42b0-a4db-fa0192e428de', 'created_at': datetime.datetime(2026, 4, 27, 13, 1, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 13, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17408032-d085-42b0-a4db-fa0192e428de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f59e4d14c70>}
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Trying to clone 4d362179-7c7f-4c77-bd46-ebe356ea1662 from image 17408032-d085-42b0-a4db-fa0192e428de at location (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]). {{(pid=81538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 27 15:09:25 devstack sudo[85246]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd" returned: 0 in 0.739s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Lock "cinder-quobyte-45d6d67d-70d8-4095-ad1c-00444d78f7cd" released by "_copy_volume_from_snapshot" :: held 10.713s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Acquiring lock "cinder-quobyte-44a51584-df7c-4e62-a800-212419d49114" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Lock "cinder-quobyte-44a51584-df7c-4e62-a800-212419d49114" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Deleting offline snapshot 44a51584-df7c-4e62-a800-212419d49114 of volume ae39ae55-38da-4fbe-8289-8bece7f5a8d3 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] snapshot_file for this snap is: volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c33b786-1ff0-4a62-be4d-d4953da15df5]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:25 devstack sudo[85274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114
Apr 27 15:09:25 devstack sudo[85274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_11i90ve5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81538) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 27 15:09:25 devstack cinder-volume[81538]: INFO cinder.image.image_utils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Image download 20.69 MB at 20.69 MB/s
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4624a3a-e823-41c5-90a2-3f6c6f771a6a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_11i90ve5devstack@QuobyteHD {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:25 devstack sudo[85276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_11i90ve5devstack@QuobyteHD
Apr 27 15:09:25 devstack sudo[85276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:26 devstack sudo[85274]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114" returned: 0 in 0.664s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:26 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:09:26 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff1f65a-a604-4ef4-a07e-8c8e412c95cc]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:26 devstack sudo[85281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3
Apr 27 15:09:26 devstack sudo[85281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:26 devstack sudo[85276]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_11i90ve5devstack@QuobyteHD" returned: 0 in 0.647s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:26 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Temporary image 17408032-d085-42b0-a4db-fa0192e428de is fetched for user 55a2a8edb5754afc843101fd00a1bcda. {{(pid=81538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 27 15:09:26 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c2dca4-28bd-42a0-8437-ca3197ca9a25]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_11i90ve5devstack@QuobyteHD {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:26 devstack sudo[85286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_11i90ve5devstack@QuobyteHD
Apr 27 15:09:26 devstack sudo[85286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:26 devstack sudo[85281]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3" returned: 0 in 0.657s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:26 devstack sudo[85291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114
Apr 27 15:09:26 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:26 devstack sudo[85286]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_11i90ve5devstack@QuobyteHD" returned: 0 in 0.618s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:27 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114" returned: 0 in 0.712s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:27 devstack sudo[85299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114
Apr 27 15:09:27 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:27 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3.44a51584-df7c-4e62-a800-212419d49114" returned: 0 in 0.480s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Lock "cinder-quobyte-44a51584-df7c-4e62-a800-212419d49114" released by "_delete_snapshot" :: held 2.646s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.963s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.086s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2033555381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='945497138381498fa173992a61e2cb6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:19Z,use_quota=True,user_id='37f7b8e4de6840e5a76d8ea63683db0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Creating volume c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:09:27 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:09:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:28 devstack sudo[85302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d 1073741824
Apr 27 15:09:28 devstack sudo[85302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:28 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-59d228cb-38aa-484d-992e-c1c394e4e248 tempest-GroupsV314Test-139484149 None] Create group from source-group-24ddf5ad-f45e-4425-8ccc-5cdcb21499a2 completed successfully.
Apr 27 15:09:28 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:09:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Flow 'volume_create_manager' (c4dcf958-2f68-4493-aa62-25ab64f9e845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f86774-b8e9-4eed-8926-65526051093b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:28 devstack sudo[85302]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f86774-b8e9-4eed-8926-65526051093b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-643866570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341d0608-4261-44d9-8077-1816b410be2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfd89d8844041d1a1e1dc19beb4cc82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:29Z,use_quota=True,user_id='c32ab1753f4f4cb981fb417df7d7f446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47117710-0c84-4ab1-a3ec-5e373403f135),volume_type_id=47117710-0c84-4ab1-a3ec-5e373403f135)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90feb854-9837-48b7-b2c6-2317425ac19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90feb854-9837-48b7-b2c6-2317425ac19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e4eb12-160e-4bc0-9566-133a67cff50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e4eb12-160e-4bc0-9566-133a67cff50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '341d0608-4261-44d9-8077-1816b410be2e', 'volume_name': 'volume-341d0608-4261-44d9-8077-1816b410be2e', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12d05a0-cafe-4829-a387-f6992898f345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12d05a0-cafe-4829-a387-f6992898f345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5078a1a5-a67b-4f98-b8f0-5594b0977c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:28 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Volume 341d0608-4261-44d9-8077-1816b410be2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-341d0608-4261-44d9-8077-1816b410be2e', 'volume_size': 1}
Apr 27 15:09:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d 1073741824" returned: 0 in 0.775s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:28 devstack sudo[85308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d
Apr 27 15:09:28 devstack sudo[85308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:29 devstack sudo[85308]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d" returned: 0 in 0.464s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.325s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:24Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d362179-7c7f-4c77-bd46-ebe356ea1662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c0076463854a69a33466a2bd535c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:24Z,use_quota=True,user_id='55a2a8edb5754afc843101fd00a1bcda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Creating volume 4d362179-7c7f-4c77-bd46-ebe356ea1662 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:09:29 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c05078b-a693-4a31-9ad3-c41799dee0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:29 devstack sudo[85311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 1073741824
Apr 27 15:09:29 devstack sudo[85311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55608309-8651-412b-88dc-214944f905b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:29 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Volume volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d (c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d): created successfully
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55608309-8651-412b-88dc-214944f905b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Flow 'volume_create_manager' (574df171-9fc9-4bfe-8f30-10850e2bcaeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:29 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-150f0d14-7f96-42c5-8503-d31a59bc16f4 req-a5d50e40-5ddc-421f-b663-12e67f9997fa tempest-VolumesGetTestJSON-1081948160 None] Created volume successfully.
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Acquiring lock "cinder-quobyte-45d6d67d-70d8-4095-ad1c-00444d78f7cd" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Lock "cinder-quobyte-45d6d67d-70d8-4095-ad1c-00444d78f7cd" acquired by "delete_volume" :: waited 0.032s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dc3ce7-e8cd-4d22-8e3a-80a4f09ccf28]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:29 devstack sudo[85313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd
Apr 27 15:09:29 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:30 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd" returned: 0 in 0.587s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:30 devstack sudo[85321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd
Apr 27 15:09:30 devstack sudo[85321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:30 devstack sudo[85311]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 1073741824" returned: 0 in 0.815s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:30 devstack sudo[85323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662
Apr 27 15:09:30 devstack sudo[85323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Acquiring lock "cinder-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Lock "cinder-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Acquiring lock "cinder-quobyte-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Lock "cinder-quobyte-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d" acquired by "delete_volume" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[218ef08c-ddb7-4675-b17e-309b701e8234]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:30 devstack sudo[85325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d
Apr 27 15:09:30 devstack sudo[85325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:30 devstack sudo[85321]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-45d6d67d-70d8-4095-ad1c-00444d78f7cd" returned: 0 in 0.504s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Lock "cinder-quobyte-45d6d67d-70d8-4095-ad1c-00444d78f7cd" released by "delete_volume" :: held 1.135s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Created reservations ['f13077ef-2b7f-4898-a4e5-f88f94411bb6'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:09:30 devstack cinder-volume[81538]: WARNING cinder.quota [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2013564912 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2013564912, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:09:30 devstack cinder-volume[81538]: WARNING cinder.quota [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2013564912 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2013564912, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Created reservations ['622273ad-0fe1-4989-b67a-673e0e2e3bfa', '995489f3-56f5-4d66-8f61-1eba20f1cfd6', '073a40a5-6772-4766-8c2c-2ffc9e321568', '14f2e138-1ada-41f3-8402-93ee48c3f633'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:09:30 devstack sudo[85323]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662" returned: 0 in 0.559s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-643866570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341d0608-4261-44d9-8077-1816b410be2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfd89d8844041d1a1e1dc19beb4cc82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:29Z,use_quota=True,user_id='c32ab1753f4f4cb981fb417df7d7f446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47117710-0c84-4ab1-a3ec-5e373403f135),volume_type_id=47117710-0c84-4ab1-a3ec-5e373403f135)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Creating volume 341d0608-4261-44d9-8077-1816b410be2e {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:09:30 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-341d0608-4261-44d9-8077-1816b410be2e 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:30 devstack sudo[85332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-341d0608-4261-44d9-8077-1816b410be2e 1073741824
Apr 27 15:09:30 devstack sudo[85332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.volume.volume_utils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Attempting download of 17408032-d085-42b0-a4db-fa0192e428de ((None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}])) to volume 4d362179-7c7f-4c77-bd46-ebe356ea1662. {{(pid=81538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:30 devstack sudo[85335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:09:30 devstack sudo[85335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a61dba3-c5ac-41b3-a1e4-1b57228c51f7]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_4t58hy4k {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:30 devstack sudo[85325]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d" returned: 0 in 0.603s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:30 devstack sudo[85338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d
Apr 27 15:09:30 devstack sudo[85338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:30 devstack sudo[85337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_4t58hy4k
Apr 27 15:09:30 devstack sudo[85337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:31 devstack sudo[85335]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.533s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:09:31 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-6b1833bd-fbb6-4d1f-b040-fda6a0f3db27 tempest-GroupsV314Test-139484149 None] Delete group completed successfully.
Apr 27 15:09:31 devstack sudo[85337]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_4t58hy4k" returned: 0 in 0.544s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_4t58hy4k {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:31 devstack sudo[85338]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d" returned: 0 in 0.550s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Lock "cinder-quobyte-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d" released by "delete_volume" :: held 1.195s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:31 devstack sudo[85332]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-341d0608-4261-44d9-8077-1816b410be2e 1073741824" returned: 0 in 0.735s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:31 devstack sudo[85348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_4t58hy4k
Apr 27 15:09:31 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-341d0608-4261-44d9-8077-1816b410be2e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG cinder.quota [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Created reservations ['693e4181-7878-4fac-9e0d-9dadb294eb8d', '8c140c03-3c92-4d74-ac9e-9f1ea3b64602', '75f9a5ad-a48d-4e0d-a746-7b728950b93d', 'c031eb14-417e-4f42-b715-dbb7dbbf5f5a'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:09:31 devstack sudo[85350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-341d0608-4261-44d9-8077-1816b410be2e
Apr 27 15:09:31 devstack sudo[85350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:31 devstack sudo[85352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:09:31 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Acquiring lock "cinder-quobyte-ae39ae55-38da-4fbe-8289-8bece7f5a8d3" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Lock "cinder-quobyte-ae39ae55-38da-4fbe-8289-8bece7f5a8d3" acquired by "delete_volume" :: waited 0.041s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b27775-68ee-4a15-9cf3-392dd2e6457d]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:31 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_4t58hy4k" returned: 1 in 0.584s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_4t58hy4k' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:09:31 devstack sudo[85356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3
Apr 27 15:09:31 devstack sudo[85356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[304c924a-d2f1-4e4e-9ff9-c1e0d47e31c9]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_11i90ve5devstack@QuobyteHD {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:32 devstack sudo[85358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_11i90ve5devstack@QuobyteHD
Apr 27 15:09:32 devstack sudo[85358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:32 devstack sudo[85350]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-341d0608-4261-44d9-8077-1816b410be2e" returned: 0 in 0.619s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:32 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5078a1a5-a67b-4f98-b8f0-5594b0977c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-341d0608-4261-44d9-8077-1816b410be2e', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325def75-6495-4eb8-baa7-dbc5f6b98a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.547s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG cinder.manager [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:09:32 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Volume volume-341d0608-4261-44d9-8077-1816b410be2e (341d0608-4261-44d9-8077-1816b410be2e): created successfully
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325def75-6495-4eb8-baa7-dbc5f6b98a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Flow 'volume_create_manager' (c4dcf958-2f68-4493-aa62-25ab64f9e845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:32 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Deleted volume successfully.
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-8d584b33-e806-46da-a642-615572063851 req-aa087d1a-c23c-4aa1-9b57-b25a4f4cd6b2 tempest-VolumesGetTestJSON-1081948160 None] Lock "cinder-c48f7927-f887-4aa1-b4ec-bd5b65ff0b3d-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:32 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-544e43a3-9f56-4c71-8cb4-d629aca99c0a tempest-VolumeTypesAccessTest-2045027975 None] Created volume successfully.
Apr 27 15:09:32 devstack sudo[85356]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3" returned: 0 in 0.571s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:32 devstack sudo[85366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3
Apr 27 15:09:32 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:32 devstack sudo[85358]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_11i90ve5devstack@QuobyteHD" returned: 0 in 0.596s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] 17408032-d085-42b0-a4db-fa0192e428de was qcow2, converting to raw {{(pid=81538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 27 15:09:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_11i90ve5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:32 devstack sudo[85370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_11i90ve5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662
Apr 27 15:09:32 devstack sudo[85370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:33 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ae39ae55-38da-4fbe-8289-8bece7f5a8d3" returned: 0 in 0.589s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Lock "cinder-quobyte-ae39ae55-38da-4fbe-8289-8bece7f5a8d3" released by "delete_volume" :: held 1.229s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Created reservations ['34877caa-a6d5-47bc-b4cb-35c846cc04a0'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Acquiring lock "cinder-341d0608-4261-44d9-8077-1816b410be2e-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Created reservations ['ccc11b28-d94c-47bf-9496-753b89ffe899', '696b9d8b-601f-44e4-8730-89211e7ebf14', '8fe88569-7dae-4e45-bbaa-817b486d58f9', 'c988db77-8d01-4ebd-8bdb-a68234e49ef9'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Lock "cinder-341d0608-4261-44d9-8077-1816b410be2e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Acquiring lock "cinder-quobyte-341d0608-4261-44d9-8077-1816b410be2e" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Lock "cinder-quobyte-341d0608-4261-44d9-8077-1816b410be2e" acquired by "delete_volume" :: waited 0.050s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a1094d-8c56-4718-b300-25ce27bee509]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-341d0608-4261-44d9-8077-1816b410be2e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:33 devstack sudo[85387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:09:33 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:33 devstack sudo[85384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-341d0608-4261-44d9-8077-1816b410be2e
Apr 27 15:09:33 devstack sudo[85384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:34 devstack sudo[85384]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-341d0608-4261-44d9-8077-1816b410be2e" returned: 0 in 0.845s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-341d0608-4261-44d9-8077-1816b410be2e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:34 devstack sudo[85398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-341d0608-4261-44d9-8077-1816b410be2e
Apr 27 15:09:34 devstack sudo[85398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:34 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.838s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:34 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:09:34 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-0967b640-33bf-4819-9036-55c81e14c55d tempest-GroupsV314Test-139484149 None] Delete group completed successfully.
Apr 27 15:09:34 devstack sudo[85370]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_11i90ve5devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662" returned: 0 in 1.717s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:34 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_11i90ve5devstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:09:34 devstack cinder-volume[81538]: INFO cinder.image.image_utils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Converted 112.00 MB image at 65.14 MB/s
Apr 27 15:09:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:34 devstack sudo[85400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 1G
Apr 27 15:09:34 devstack sudo[85400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:34 devstack sudo[85400]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 1G" returned: 0 in 0.560s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:34 devstack sudo[85398]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-341d0608-4261-44d9-8077-1816b410be2e" returned: 0 in 0.674s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:34 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Lock "cinder-quobyte-341d0608-4261-44d9-8077-1816b410be2e" released by "delete_volume" :: held 1.589s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:34 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[afad84a6-a948-4d09-b021-cf313c0a7bd5]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:34 devstack cinder-volume[81538]: WARNING cinder.quota [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-461203317 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-461203317, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:09:34 devstack cinder-volume[81538]: WARNING cinder.quota [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-461203317 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-461203317, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:09:34 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Created reservations ['e820a7f4-7f4b-4a1c-a604-a6551028b36b', '79d72ac9-6505-4d3e-85b8-89b1dfa82123', '34c97f4d-a336-42ed-87d1-47f1ff48014d', 'f67e1ee3-ebde-4602-b962-2d221e009ead'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:09:34 devstack sudo[85406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662
Apr 27 15:09:34 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:35 devstack sudo[85408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:09:35 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:35 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662" returned: 0 in 0.883s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:35 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.809s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:35 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:09:35 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Deleted volume successfully.
Apr 27 15:09:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1cb8850c-6b1e-43dd-9526-6341b345f458 tempest-VolumeTypesAccessTest-2045027975 None] Lock "cinder-341d0608-4261-44d9-8077-1816b410be2e-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:35 devstack sudo[85413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662
Apr 27 15:09:35 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:36 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662" returned: 1 in 0.809s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:09:36 devstack cinder-volume[81538]: DEBUG cinder.volume.volume_utils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Downloaded image 17408032-d085-42b0-a4db-fa0192e428de ((None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}])) to volume 4d362179-7c7f-4c77-bd46-ebe356ea1662 successfully. {{(pid=81538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 27 15:09:36 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Temporary image 17408032-d085-42b0-a4db-fa0192e428de for user 55a2a8edb5754afc843101fd00a1bcda is deleted. {{(pid=81538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 27 15:09:36 devstack cinder-volume[81538]: DEBUG cinder.volume.volume_utils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Marking volume 4d362179-7c7f-4c77-bd46-ebe356ea1662 as bootable. {{(pid=81538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 27 15:09:36 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Copying metadata from image 17408032-d085-42b0-a4db-fa0192e428de to 4d362179-7c7f-4c77-bd46-ebe356ea1662. {{(pid=81538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 27 15:09:36 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Creating volume glance metadata for volume 4d362179-7c7f-4c77-bd46-ebe356ea1662 backed by image 17408032-d085-42b0-a4db-fa0192e428de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 27 15:09:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df44e9d0-b808-4e72-9ff1-9f7c2475614d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d362179-7c7f-4c77-bd46-ebe356ea1662', 'volume_size': 1, 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8b5f6f0ff7c46c9826225de4a824e37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17408032-d085-42b0-a4db-fa0192e428de', 'created_at': datetime.datetime(2026, 4, 27, 13, 1, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 13, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17408032-d085-42b0-a4db-fa0192e428de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f59e4d14c70>}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a555e245-9ec6-44e2-b7c8-6ea7f54e8a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:36 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Volume volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 (4d362179-7c7f-4c77-bd46-ebe356ea1662): created successfully
Apr 27 15:09:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a555e245-9ec6-44e2-b7c8-6ea7f54e8a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Flow 'volume_create_manager' (eb25cad2-b41c-4121-952b-c03d781cf8c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:36 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-7b08a785-d1ee-42cc-92d1-ce31de4197d2 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Created volume successfully.
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Flow 'volume_create_manager' (7c885715-c9a3-445f-a99e-17efa18da64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a476784c-8358-4d95-9d8c-15ad18ddd02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a476784c-8358-4d95-9d8c-15ad18ddd02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-541497600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3186f8-b5af-4314-8065-f80eb34030a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0175574f95e478eb47f93bdd12c7d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:38Z,use_quota=True,user_id='197e83a47f8c4537a106fa5da8a37377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a363e801-2e8b-4424-9566-03e6fb958c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a363e801-2e8b-4424-9566-03e6fb958c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b8ec36-4351-40b4-b668-5b06ade76b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b8ec36-4351-40b4-b668-5b06ade76b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab3186f8-b5af-4314-8065-f80eb34030a4', 'volume_name': 'volume-ab3186f8-b5af-4314-8065-f80eb34030a4', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc3e2d7-cd77-4dc6-95cc-c1247b47165d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc3e2d7-cd77-4dc6-95cc-c1247b47165d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8942454-d809-4f49-97bc-6316c792fd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:38 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Volume ab3186f8-b5af-4314-8065-f80eb34030a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab3186f8-b5af-4314-8065-f80eb34030a4', 'volume_size': 1}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-541497600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3186f8-b5af-4314-8065-f80eb34030a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0175574f95e478eb47f93bdd12c7d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:38Z,use_quota=True,user_id='197e83a47f8c4537a106fa5da8a37377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Creating volume ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:09:38 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:38 devstack sudo[85419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4 1073741824
Apr 27 15:09:38 devstack sudo[85419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:38 devstack sudo[85419]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4 1073741824" returned: 0 in 0.745s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:39 devstack sudo[85424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4
Apr 27 15:09:39 devstack sudo[85424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:39 devstack sudo[85424]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4" returned: 0 in 0.512s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:09:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8942454-d809-4f49-97bc-6316c792fd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3186f8-b5af-4314-8065-f80eb34030a4', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b10dae-9260-4f66-958b-bfd3d6a1c6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:39 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Volume volume-ab3186f8-b5af-4314-8065-f80eb34030a4 (ab3186f8-b5af-4314-8065-f80eb34030a4): created successfully
Apr 27 15:09:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b10dae-9260-4f66-958b-bfd3d6a1c6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Flow 'volume_create_manager' (7c885715-c9a3-445f-a99e-17efa18da64e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5455c3b8-6977-422b-884c-8bf519c97957 tempest-SnapshotsActionsTest-416904391 None] Created volume successfully.
Apr 27 15:09:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-27a06c97-a043-4759-b251-b1d3b4fead73 tempest-GroupsV320Test-813780376 None] Group tempest-GroupsV320Test-Group-589100357: creating
Apr 27 15:09:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-27a06c97-a043-4759-b251-b1d3b4fead73 tempest-GroupsV320Test-813780376 None] Group tempest-GroupsV320Test-Group-589100357: created successfully
Apr 27 15:09:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-27a06c97-a043-4759-b251-b1d3b4fead73 tempest-GroupsV320Test-813780376 None] Create group completed successfully.
Apr 27 15:09:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-9be6920a-725b-4a8a-8a81-2840b9821729 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-9be6920a-725b-4a8a-8a81-2840b9821729 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:40 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b5a5af-c5b6-4208-8a76-a31fcbd104f9]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-9be6920a-725b-4a8a-8a81-2840b9821729 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:40 devstack sudo[85435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662
Apr 27 15:09:40 devstack sudo[85435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:40 devstack sudo[85435]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-9be6920a-725b-4a8a-8a81-2840b9821729 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662" returned: 0 in 0.641s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-9be6920a-725b-4a8a-8a81-2840b9821729 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:40 devstack sudo[85439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662
Apr 27 15:09:40 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-be1fa0a2-5fa8-4417-8831-b4187b309489 tempest-GroupsV320Test-813780376 None] Created reservations ['758db5ca-ba11-49f9-ac1c-a0982153a424'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:09:41 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-9be6920a-725b-4a8a-8a81-2840b9821729 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662" returned: 1 in 0.632s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-9be6920a-725b-4a8a-8a81-2840b9821729 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-9be6920a-725b-4a8a-8a81-2840b9821729 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.315s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.813s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-be1fa0a2-5fa8-4417-8831-b4187b309489 tempest-GroupsV320Test-813780376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-be1fa0a2-5fa8-4417-8831-b4187b309489 tempest-GroupsV320Test-813780376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-be1fa0a2-5fa8-4417-8831-b4187b309489 tempest-GroupsV320Test-813780376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-be1fa0a2-5fa8-4417-8831-b4187b309489 tempest-GroupsV320Test-813780376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-be1fa0a2-5fa8-4417-8831-b4187b309489 tempest-GroupsV320Test-813780376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-be1fa0a2-5fa8-4417-8831-b4187b309489 tempest-GroupsV320Test-813780376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-9be6920a-725b-4a8a-8a81-2840b9821729 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c', 'name': 'volume-4d362179-7c7f-4c77-bd46-ebe356ea1662', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '545c4e4a-7a76-46f4-8772-d92175ef03d4', 'enforce_multipath': True} {{(pid=81538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 27 15:09:41 devstack sudo[85445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:09:41 devstack sudo[85445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] Creating offline snapshot c93eb6fd-e99c-4a17-8650-cc2374380c24 of volume ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[77566e28-d504-4594-8315-1753c0f02cdc]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:41 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-7de832a5-3434-48b2-ab3f-f7604c6f9c7c req-9be6920a-725b-4a8a-8a81-2840b9821729 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] attachment_update completed successfully.
Apr 27 15:09:41 devstack sudo[85447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4
Apr 27 15:09:41 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:41 devstack sudo[85445]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-be1fa0a2-5fa8-4417-8831-b4187b309489 tempest-GroupsV320Test-813780376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.481s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:41 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-be1fa0a2-5fa8-4417-8831-b4187b309489 tempest-GroupsV320Test-813780376 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:09:41 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-be1fa0a2-5fa8-4417-8831-b4187b309489 tempest-GroupsV320Test-813780376 None] Delete group completed successfully.
Apr 27 15:09:42 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4" returned: 0 in 0.675s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:42 devstack sudo[85453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 1G
Apr 27 15:09:42 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:42 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 1G" returned: 0 in 0.788s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:42 devstack sudo[85458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24
Apr 27 15:09:42 devstack sudo[85458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:43 devstack sudo[85458]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24" returned: 0 in 0.691s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:43 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 is being set with open permissions: ugo+rw
Apr 27 15:09:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:43 devstack sudo[85465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24
Apr 27 15:09:43 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:44 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24" returned: 0 in 0.557s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:44 devstack sudo[85468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.info
Apr 27 15:09:44 devstack sudo[85468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.info" returned: 0 in 0.548s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:44 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.info is being set with open permissions: ugo+rw
Apr 27 15:09:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:44 devstack sudo[85468]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:44 devstack sudo[85471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.info
Apr 27 15:09:44 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:45 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.info" returned: 0 in 0.494s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.930s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:45 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f1e8dc0f-9217-4695-839c-61a958e636c9 tempest-SnapshotsActionsTest-416904391 None] Create snapshot completed successfully
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Flow 'volume_create_manager' (22e4266b-106a-4ac4-a7a9-c818fb23c6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6725f2d3-4983-4f9e-ab8f-dd1d027e3504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6725f2d3-4983-4f9e-ab8f-dd1d027e3504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1480143536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d853eb0b-c94f-43ed-ba7e-32ad059233f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b093cd1320cd417b8f163faecfc1f009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:46Z,use_quota=True,user_id='101db27237ba4100b4b4ccec50d94fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c3ebe8-06fc-4547-86ed-b16c95f8607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c3ebe8-06fc-4547-86ed-b16c95f8607f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995288fa-64db-4f60-add1-eeb2e4d03b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995288fa-64db-4f60-add1-eeb2e4d03b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd853eb0b-c94f-43ed-ba7e-32ad059233f7', 'volume_name': 'volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16b0e9a-2568-4232-ba63-9f7211ff0f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16b0e9a-2568-4232-ba63-9f7211ff0f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6f19ad-209e-40ab-9629-82d386b95c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:46 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Volume d853eb0b-c94f-43ed-ba7e-32ad059233f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7', 'volume_size': 1}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1480143536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d853eb0b-c94f-43ed-ba7e-32ad059233f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b093cd1320cd417b8f163faecfc1f009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:46Z,use_quota=True,user_id='101db27237ba4100b4b4ccec50d94fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Creating volume d853eb0b-c94f-43ed-ba7e-32ad059233f7 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:09:46 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:46 devstack sudo[85481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7 1073741824
Apr 27 15:09:46 devstack sudo[85481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:47 devstack sudo[85481]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7 1073741824" returned: 0 in 0.821s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:47 devstack sudo[85509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7
Apr 27 15:09:47 devstack sudo[85509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:48 devstack sudo[85509]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7" returned: 0 in 0.601s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.455s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6f19ad-209e-40ab-9629-82d386b95c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0c4e96-bad1-4d18-bc35-f9d7750fe51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] Creating offline snapshot 5c542f07-bcb3-44ea-b964-aa2fc5c4b26e of volume ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:09:48 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Volume volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7 (d853eb0b-c94f-43ed-ba7e-32ad059233f7): created successfully
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0c4e96-bad1-4d18-bc35-f9d7750fe51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Flow 'volume_create_manager' (22e4266b-106a-4ac4-a7a9-c818fb23c6fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[af767724-17a0-4da7-9383-ecb802292a8f]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:48 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-fce5cd1a-6968-4b0f-9851-127033586548 tempest-VolumesTransfersTest-1860170026 None] Created volume successfully.
Apr 27 15:09:48 devstack sudo[85530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24
Apr 27 15:09:48 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG oslo_service.periodic_task [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81538) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:48 devstack sudo[85545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:09:48 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:49 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24" returned: 0 in 1.631s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3186f8-b5af-4314-8065-f80eb34030a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:09:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:49 devstack sudo[85552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e 1G
Apr 27 15:09:49 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:50 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-38c66fd2-cccc-4882-b66b-f37bc3937fce tempest-VolumesTransfersTest-1443965370 None] Transfer volume completed successfully.
Apr 27 15:09:50 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 1.364s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:50 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:09:51 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e 1G" returned: 0 in 1.662s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:51 devstack sudo[85559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e
Apr 27 15:09:51 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Acquiring lock "cinder-d853eb0b-c94f-43ed-ba7e-32ad059233f7-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Lock "cinder-d853eb0b-c94f-43ed-ba7e-32ad059233f7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Acquiring lock "cinder-quobyte-d853eb0b-c94f-43ed-ba7e-32ad059233f7" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Lock "cinder-quobyte-d853eb0b-c94f-43ed-ba7e-32ad059233f7" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:51 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c5d493-cee4-46ac-b6ae-263aa62671c8]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:51 devstack sudo[85562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7
Apr 27 15:09:52 devstack sudo[85562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:52 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e" returned: 0 in 1.202s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:52 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e is being set with open permissions: ugo+rw
Apr 27 15:09:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:52 devstack sudo[85569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e
Apr 27 15:09:52 devstack sudo[85569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:52 devstack sudo[85562]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7" returned: 0 in 1.103s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:52 devstack sudo[85572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7
Apr 27 15:09:52 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:53 devstack sudo[85569]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e" returned: 0 in 1.170s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.836s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:53 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-956133b5-04a9-48f3-8c7a-e6e975e91b4f tempest-SnapshotsActionsTest-416904391 None] Create snapshot completed successfully
Apr 27 15:09:54 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d853eb0b-c94f-43ed-ba7e-32ad059233f7" returned: 0 in 1.091s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Lock "cinder-quobyte-d853eb0b-c94f-43ed-ba7e-32ad059233f7" released by "delete_volume" :: held 2.251s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:54 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Created reservations ['f4292013-b27e-4c94-b7b4-c5d513f92a0b', '214d66d8-acf2-4fe2-8644-a2858d6c660c', '4ce1dd34-3c4f-4b7e-80bd-72da20e44629', '67b86747-4810-4996-b39c-fa9ab61a6d80'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:09:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:54 devstack sudo[85577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:09:54 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:54 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.566s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:54 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:09:54 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Deleted volume successfully.
Apr 27 15:09:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-318da9c7-8177-4235-ae4c-64d90d52dd4a tempest-VolumesTransfersTest-675862136 None] Lock "cinder-d853eb0b-c94f-43ed-ba7e-32ad059233f7-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Acquiring lock "cinder-5c542f07-bcb3-44ea-b964-aa2fc5c4b26e-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-5c542f07-bcb3-44ea-b964-aa2fc5c4b26e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Acquiring lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Acquiring lock "cinder-quobyte-5c542f07-bcb3-44ea-b964-aa2fc5c4b26e" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-5c542f07-bcb3-44ea-b964-aa2fc5c4b26e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Deleting offline snapshot 5c542f07-bcb3-44ea-b964-aa2fc5c4b26e of volume ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:09:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] snapshot_file for this snap is: volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:09:55 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[087104ae-8ced-4706-afdc-f0e1d3e8999d]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:55 devstack sudo[85580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e
Apr 27 15:09:55 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Flow 'volume_create_manager' (40cc33e5-529b-4afb-9275-31017a1b8251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06241fc3-f820-468c-bc95-d509f234ebb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06241fc3-f820-468c-bc95-d509f234ebb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-615467257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ca9e42-abe7-49d0-b78c-f25acee45094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b093cd1320cd417b8f163faecfc1f009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:56Z,use_quota=True,user_id='101db27237ba4100b4b4ccec50d94fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad102d1-ac11-4cee-aa3a-720bb4bde69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad102d1-ac11-4cee-aa3a-720bb4bde69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09cce10-9948-447b-8eed-b659ffde9b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09cce10-9948-447b-8eed-b659ffde9b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ca9e42-abe7-49d0-b78c-f25acee45094', 'volume_name': 'volume-73ca9e42-abe7-49d0-b78c-f25acee45094', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec9c453-37a6-4bf4-b09d-1324f92547db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec9c453-37a6-4bf4-b09d-1324f92547db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a577e58a-eafe-4266-b8d0-81da6c5aa1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:56 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Volume 73ca9e42-abe7-49d0-b78c-f25acee45094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ca9e42-abe7-49d0-b78c-f25acee45094', 'volume_size': 1}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-615467257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ca9e42-abe7-49d0-b78c-f25acee45094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b093cd1320cd417b8f163faecfc1f009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:09:56Z,use_quota=True,user_id='101db27237ba4100b4b4ccec50d94fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Creating volume 73ca9e42-abe7-49d0-b78c-f25acee45094 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:09:56 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-73ca9e42-abe7-49d0-b78c-f25acee45094 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:56 devstack sudo[85585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-73ca9e42-abe7-49d0-b78c-f25acee45094 1073741824
Apr 27 15:09:56 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:56 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e" returned: 0 in 0.965s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3186f8-b5af-4314-8065-f80eb34030a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[735bda6c-7a17-442c-8166-105799f39a07]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:56 devstack sudo[85587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24
Apr 27 15:09:56 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:57 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24" returned: 0 in 1.084s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:57 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3186f8-b5af-4314-8065-f80eb34030a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:09:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:57 devstack sudo[85631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e
Apr 27 15:09:57 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:57 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-73ca9e42-abe7-49d0-b78c-f25acee45094 1073741824" returned: 0 in 1.217s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-73ca9e42-abe7-49d0-b78c-f25acee45094 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:57 devstack sudo[85633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-73ca9e42-abe7-49d0-b78c-f25acee45094
Apr 27 15:09:57 devstack sudo[85633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:58 devstack sudo[85633]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-73ca9e42-abe7-49d0-b78c-f25acee45094" returned: 0 in 0.769s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:58 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:09:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:09:58 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a577e58a-eafe-4266-b8d0-81da6c5aa1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ca9e42-abe7-49d0-b78c-f25acee45094', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:58 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189fc521-6e35-4090-9f63-bb85cc029dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:09:58 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Volume volume-73ca9e42-abe7-49d0-b78c-f25acee45094 (73ca9e42-abe7-49d0-b78c-f25acee45094): created successfully
Apr 27 15:09:58 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189fc521-6e35-4090-9f63-bb85cc029dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:09:58 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Flow 'volume_create_manager' (40cc33e5-529b-4afb-9275-31017a1b8251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:09:58 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:58 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-360f9b08-d82f-46f7-8d8d-1b683aebcd0f tempest-VolumesTransfersTest-1860170026 None] Created volume successfully.
Apr 27 15:09:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e" returned: 0 in 0.929s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:58 devstack sudo[85666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e
Apr 27 15:09:58 devstack sudo[85666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:09:58 devstack sudo[85666]: pam_unix(sudo:session): session closed for user root
Apr 27 15:09:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.5c542f07-bcb3-44ea-b964-aa2fc5c4b26e" returned: 0 in 0.590s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:09:58 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-5c542f07-bcb3-44ea-b964-aa2fc5c4b26e" released by "_delete_snapshot" :: held 3.679s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:58 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" released by "delete_snapshot" :: held 3.708s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:58 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Created reservations ['3d8aacd6-56fc-4ea0-a4e8-9fd45da965c3', 'ff4ee9bc-864b-443b-b244-364aeff16a5a', '84ca78b5-6235-4327-995d-bb10035ce9c5', '2cb17323-e2f0-4db8-8deb-4b1539f2d70f'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:09:59 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Delete snapshot completed successfully.
Apr 27 15:09:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fcf0ed41-dac7-4de8-9b64-f41d77f70b35 tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-5c542f07-bcb3-44ea-b964-aa2fc5c4b26e-delete_snapshot" released by "delete_snapshot" :: held 3.864s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:09:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Acquiring lock "cinder-73ca9e42-abe7-49d0-b78c-f25acee45094-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Lock "cinder-73ca9e42-abe7-49d0-b78c-f25acee45094-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Acquiring lock "cinder-quobyte-73ca9e42-abe7-49d0-b78c-f25acee45094" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:09:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Lock "cinder-quobyte-73ca9e42-abe7-49d0-b78c-f25acee45094" acquired by "delete_volume" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:09:59 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfccf993-c167-42ff-a3bd-928e9d5603c8]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:09:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-73ca9e42-abe7-49d0-b78c-f25acee45094 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:09:59 devstack sudo[85670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-73ca9e42-abe7-49d0-b78c-f25acee45094
Apr 27 15:09:59 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] Creating offline snapshot 60e82e67-22e0-4e0d-9749-f2be31f8ca01 of volume ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:10:00 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a154945f-5590-4a98-8b49-b34ca465e54f]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:00 devstack sudo[85673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24
Apr 27 15:10:00 devstack sudo[85673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:00 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-73ca9e42-abe7-49d0-b78c-f25acee45094" returned: 0 in 0.773s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-73ca9e42-abe7-49d0-b78c-f25acee45094 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:00 devstack sudo[85688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-73ca9e42-abe7-49d0-b78c-f25acee45094
Apr 27 15:10:00 devstack sudo[85688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:00 devstack sudo[85673]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24" returned: 0 in 0.651s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3186f8-b5af-4314-8065-f80eb34030a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:10:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:00 devstack sudo[85701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01 1G
Apr 27 15:10:00 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:01 devstack sudo[85688]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-73ca9e42-abe7-49d0-b78c-f25acee45094" returned: 0 in 0.554s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Lock "cinder-quobyte-73ca9e42-abe7-49d0-b78c-f25acee45094" released by "delete_volume" :: held 1.418s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:UPDATE=103,cinder:SELECT=99,cinder:INSERT=33,cinder:DELETE=7 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Created reservations ['42c12b8b-2c6c-42a3-8ab8-7ef722ab07ac', '505fc475-d48f-41ba-843b-b18e177ea454', '2c3a26e4-d926-4c06-99c1-ba1a4af62fe0', '2dd4ed1f-78ae-4fa0-ab59-4e36c400541c'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:01 devstack sudo[85704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:10:01 devstack sudo[85704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:01 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01 1G" returned: 0 in 0.930s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:01 devstack sudo[85709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01
Apr 27 15:10:01 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:01 devstack sudo[85704]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.649s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:10:01 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Deleted volume successfully.
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=115,cinder:UPDATE=106,cinder:DELETE=8,cinder:INSERT=24 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:10:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1b6af354-43c1-4a11-9291-e62a80173191 tempest-VolumesTransfersTest-675862136 None] Lock "cinder-73ca9e42-abe7-49d0-b78c-f25acee45094-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:02 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01" returned: 0 in 0.619s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:02 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01 is being set with open permissions: ugo+rw
Apr 27 15:10:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:02 devstack sudo[85716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01
Apr 27 15:10:02 devstack sudo[85716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:02 devstack sudo[85716]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01" returned: 0 in 0.498s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.850s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:02 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ed05560f-35f7-4c64-90f4-770571942633 tempest-SnapshotsActionsTest-416904391 None] Create snapshot completed successfully
Apr 27 15:10:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Acquiring lock "cinder-60e82e67-22e0-4e0d-9749-f2be31f8ca01-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-60e82e67-22e0-4e0d-9749-f2be31f8ca01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Acquiring lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Acquiring lock "cinder-quobyte-60e82e67-22e0-4e0d-9749-f2be31f8ca01" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-60e82e67-22e0-4e0d-9749-f2be31f8ca01" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Deleting offline snapshot 60e82e67-22e0-4e0d-9749-f2be31f8ca01 of volume ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:10:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] snapshot_file for this snap is: volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:10:03 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea2816b-ee4c-4ed9-a427-36605ef4de8a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:03 devstack sudo[85721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01
Apr 27 15:10:03 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:04 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01" returned: 0 in 0.756s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3186f8-b5af-4314-8065-f80eb34030a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc55cad-5133-40d1-8bf9-845860f32de1]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:10:04 devstack sudo[85726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24
Apr 27 15:10:04 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Flow 'volume_create_manager' (928a3cec-7b3b-4ad2-8b3a-7c18ea003c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c290f44d-be6d-48d3-8f1a-5bde29e78ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c290f44d-be6d-48d3-8f1a-5bde29e78ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1455237026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12565c41-b685-4a5c-97e5-8b3d0d88abba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b52833ec8f442a996203b9837c6649e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:04Z,use_quota=True,user_id='ada81b65a80e4522b0caa1489c6e8992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19425105-a48e-497a-8165-e65b3acffb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19425105-a48e-497a-8165-e65b3acffb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7761493f-2f35-435b-b3a1-097d6fd0c820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7761493f-2f35-435b-b3a1-097d6fd0c820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12565c41-b685-4a5c-97e5-8b3d0d88abba', 'volume_name': 'volume-12565c41-b685-4a5c-97e5-8b3d0d88abba', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbc2c17-447a-4cb2-8e53-b183136c1e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbc2c17-447a-4cb2-8e53-b183136c1e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1239ad97-53d1-474d-bbc2-0f562bb5c4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:04 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Volume 12565c41-b685-4a5c-97e5-8b3d0d88abba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12565c41-b685-4a5c-97e5-8b3d0d88abba', 'volume_size': 1}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1455237026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12565c41-b685-4a5c-97e5-8b3d0d88abba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b52833ec8f442a996203b9837c6649e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:04Z,use_quota=True,user_id='ada81b65a80e4522b0caa1489c6e8992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Creating volume 12565c41-b685-4a5c-97e5-8b3d0d88abba {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:10:04 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-12565c41-b685-4a5c-97e5-8b3d0d88abba 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:04 devstack sudo[85728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-12565c41-b685-4a5c-97e5-8b3d0d88abba 1073741824
Apr 27 15:10:04 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:04 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24" returned: 0 in 0.683s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3186f8-b5af-4314-8065-f80eb34030a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:10:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:04 devstack sudo[85737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01
Apr 27 15:10:04 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:05 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-12565c41-b685-4a5c-97e5-8b3d0d88abba 1073741824" returned: 0 in 0.826s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-12565c41-b685-4a5c-97e5-8b3d0d88abba {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:05 devstack sudo[85744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-12565c41-b685-4a5c-97e5-8b3d0d88abba
Apr 27 15:10:05 devstack sudo[85744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:05 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01" returned: 0 in 0.984s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:05 devstack sudo[85754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01
Apr 27 15:10:05 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:05 devstack sudo[85744]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-12565c41-b685-4a5c-97e5-8b3d0d88abba" returned: 0 in 0.616s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:05 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:10:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1239ad97-53d1-474d-bbc2-0f562bb5c4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12565c41-b685-4a5c-97e5-8b3d0d88abba', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2328cd4f-f7d3-4ee2-8696-9d5dbdb1ecc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:05 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Volume volume-12565c41-b685-4a5c-97e5-8b3d0d88abba (12565c41-b685-4a5c-97e5-8b3d0d88abba): created successfully
Apr 27 15:10:06 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2328cd4f-f7d3-4ee2-8696-9d5dbdb1ecc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:06 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Flow 'volume_create_manager' (928a3cec-7b3b-4ad2-8b3a-7c18ea003c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:06 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-bb545174-c83b-4ad5-8b7f-0d0bc589edfb tempest-VolumeQuotasAdminTestJSON-435252041 None] Created volume successfully.
Apr 27 15:10:06 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.60e82e67-22e0-4e0d-9749-f2be31f8ca01" returned: 0 in 0.720s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-60e82e67-22e0-4e0d-9749-f2be31f8ca01" released by "_delete_snapshot" :: held 3.336s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" released by "delete_snapshot" :: held 3.370s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Acquiring lock "cinder-12565c41-b685-4a5c-97e5-8b3d0d88abba-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Lock "cinder-12565c41-b685-4a5c-97e5-8b3d0d88abba-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:06 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Created reservations ['a842407c-fbf2-4981-a993-caf56138a3a2', 'aa206820-9593-4dc1-bb12-9e82c418e9c4', 'ce7114b5-b5aa-44ad-be69-b3183578fc89', 'a222e399-3abe-4b9b-a13d-8b8a675839a3'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Acquiring lock "cinder-quobyte-12565c41-b685-4a5c-97e5-8b3d0d88abba" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Lock "cinder-quobyte-12565c41-b685-4a5c-97e5-8b3d0d88abba" acquired by "delete_volume" :: waited 0.026s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:07 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5363d9c5-42be-4582-a21d-f0ec71f6265a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-12565c41-b685-4a5c-97e5-8b3d0d88abba {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:07 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Delete snapshot completed successfully.
Apr 27 15:10:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2b803ca4-ca0e-4798-a097-bf4dfe0e3b9c tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-60e82e67-22e0-4e0d-9749-f2be31f8ca01-delete_snapshot" released by "delete_snapshot" :: held 3.913s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:07 devstack sudo[85793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-12565c41-b685-4a5c-97e5-8b3d0d88abba
Apr 27 15:10:07 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:08 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-12565c41-b685-4a5c-97e5-8b3d0d88abba" returned: 0 in 1.070s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-12565c41-b685-4a5c-97e5-8b3d0d88abba {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:08 devstack sudo[85799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-12565c41-b685-4a5c-97e5-8b3d0d88abba
Apr 27 15:10:08 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] Creating offline snapshot 9a8f2c2f-657b-467f-b802-7b3184d6504b of volume ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:10:08 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaaa611-accd-488a-830a-d426b4d63d77]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:08 devstack sudo[85802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24
Apr 27 15:10:08 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:09 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-12565c41-b685-4a5c-97e5-8b3d0d88abba" returned: 0 in 1.053s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Lock "cinder-quobyte-12565c41-b685-4a5c-97e5-8b3d0d88abba" released by "delete_volume" :: held 2.196s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:09 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Created reservations ['0b6e19a4-d665-4ef3-9adb-d59832a6f4b6', '3b16b61e-a271-40ae-b864-28de962c62fa', '88502132-806c-4d9d-a26a-1758ff10fb09', '8ef0e9a7-6cb7-4ba7-8c25-7bfe9f89ad25'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24" returned: 0 in 1.048s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3186f8-b5af-4314-8065-f80eb34030a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:09 devstack sudo[85810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b 1G
Apr 27 15:10:09 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:09 devstack sudo[85812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:10:09 devstack sudo[85812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:09 devstack sudo[85812]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.479s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:10:09 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Deleted volume successfully.
Apr 27 15:10:09 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6445e62c-596a-43f5-96df-376cdefc46fd tempest-VolumeQuotasAdminTestJSON-435252041 None] Lock "cinder-12565c41-b685-4a5c-97e5-8b3d0d88abba-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Flow 'volume_create_manager' (261c51c4-11e3-4f1a-b3a5-6a3c7b738bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d673409-1990-48a4-870b-b7cf355ac4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d673409-1990-48a4-870b-b7cf355ac4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-613776962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb861fdb-5c29-4686-89b1-ef75d923a80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093ad11ee8a3458c874e121112722e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:10Z,use_quota=True,user_id='1531272ff22b4a5b8b8f81e6e1d39b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52643528-b831-4124-9a03-fcc33f3b8ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52643528-b831-4124-9a03-fcc33f3b8ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6157fe2d-d9aa-4d34-94bb-3f8608f136da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:10 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6157fe2d-d9aa-4d34-94bb-3f8608f136da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb861fdb-5c29-4686-89b1-ef75d923a80c', 'volume_name': 'volume-eb861fdb-5c29-4686-89b1-ef75d923a80c', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1170dd-7a25-4932-8be0-fca13806206b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1170dd-7a25-4932-8be0-fca13806206b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc651d3-d7e0-4076-8907-0fad0fb6542d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:10 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Volume eb861fdb-5c29-4686-89b1-ef75d923a80c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb861fdb-5c29-4686-89b1-ef75d923a80c', 'volume_size': 1}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b 1G" returned: 0 in 1.313s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:10 devstack sudo[85818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b
Apr 27 15:10:10 devstack sudo[85818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Flow 'volume_create_manager' (15e759f4-acda-44f7-bd07-85a580255abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74575730-a098-4ed6-ac3d-c4b2bf00e918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74575730-a098-4ed6-ac3d-c4b2bf00e918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-581005377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1776559d-146f-4bf8-b07e-b12303baab12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b52833ec8f442a996203b9837c6649e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:11Z,use_quota=True,user_id='ada81b65a80e4522b0caa1489c6e8992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0adaece-ab58-486f-ad5b-44eeedd7371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0adaece-ab58-486f-ad5b-44eeedd7371d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1d9470-e427-4634-bfad-07923e414908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1d9470-e427-4634-bfad-07923e414908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1776559d-146f-4bf8-b07e-b12303baab12', 'volume_name': 'volume-1776559d-146f-4bf8-b07e-b12303baab12', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d54791a7-be43-4cb1-a621-0d0147aa4930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d54791a7-be43-4cb1-a621-0d0147aa4930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cebb4f-85ac-469c-a65b-3c31dcdd4345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:10 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Volume 1776559d-146f-4bf8-b07e-b12303baab12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1776559d-146f-4bf8-b07e-b12303baab12', 'volume_size': 1}
Apr 27 15:10:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:11 devstack sudo[85818]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b" returned: 0 in 0.576s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:11 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b is being set with open permissions: ugo+rw
Apr 27 15:10:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:11 devstack sudo[85823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b
Apr 27 15:10:11 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:11 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b" returned: 0 in 0.500s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.572s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:11 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-613776962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb861fdb-5c29-4686-89b1-ef75d923a80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093ad11ee8a3458c874e121112722e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:10Z,use_quota=True,user_id='1531272ff22b4a5b8b8f81e6e1d39b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:10:11 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Creating volume eb861fdb-5c29-4686-89b1-ef75d923a80c {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:10:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:11 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:11 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:11 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:10:11 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:10:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-eb861fdb-5c29-4686-89b1-ef75d923a80c 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:11 devstack sudo[85832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-eb861fdb-5c29-4686-89b1-ef75d923a80c 1073741824
Apr 27 15:10:11 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f9e21784-56fd-41b3-837f-f68281b9b684 tempest-SnapshotsActionsTest-416904391 None] Create snapshot completed successfully
Apr 27 15:10:11 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:12 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Acquiring lock "cinder-9a8f2c2f-657b-467f-b802-7b3184d6504b-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:12 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-9a8f2c2f-657b-467f-b802-7b3184d6504b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:12 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Acquiring lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:12 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:12 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Acquiring lock "cinder-quobyte-9a8f2c2f-657b-467f-b802-7b3184d6504b" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:12 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:12 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-9a8f2c2f-657b-467f-b802-7b3184d6504b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:12 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Deleting offline snapshot 9a8f2c2f-657b-467f-b802-7b3184d6504b of volume ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:10:12 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] snapshot_file for this snap is: volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:10:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-eb861fdb-5c29-4686-89b1-ef75d923a80c 1073741824" returned: 0 in 0.813s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:12 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8294376a-6950-47fd-9891-8a8fd747a4eb]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-eb861fdb-5c29-4686-89b1-ef75d923a80c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:12 devstack sudo[85864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-eb861fdb-5c29-4686-89b1-ef75d923a80c
Apr 27 15:10:12 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:12 devstack sudo[85862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b
Apr 27 15:10:12 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:13 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-eb861fdb-5c29-4686-89b1-ef75d923a80c" returned: 0 in 0.479s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.159s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-581005377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1776559d-146f-4bf8-b07e-b12303baab12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b52833ec8f442a996203b9837c6649e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:11Z,use_quota=True,user_id='ada81b65a80e4522b0caa1489c6e8992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Creating volume 1776559d-146f-4bf8-b07e-b12303baab12 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:10:13 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1776559d-146f-4bf8-b07e-b12303baab12 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc651d3-d7e0-4076-8907-0fad0fb6542d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb861fdb-5c29-4686-89b1-ef75d923a80c', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c4a88e-e0e1-4fc9-9792-38f8af867114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:13 devstack sudo[85878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1776559d-146f-4bf8-b07e-b12303baab12 1073741824
Apr 27 15:10:13 devstack sudo[85878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:13 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Volume volume-eb861fdb-5c29-4686-89b1-ef75d923a80c (eb861fdb-5c29-4686-89b1-ef75d923a80c): created successfully
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c4a88e-e0e1-4fc9-9792-38f8af867114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Flow 'volume_create_manager' (261c51c4-11e3-4f1a-b3a5-6a3c7b738bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:13 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-adea010e-f1e5-483a-ac84-21a68730d2f9 tempest-VolumesTransfersV355Test-82492785 None] Created volume successfully.
Apr 27 15:10:13 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b" returned: 0 in 0.609s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3186f8-b5af-4314-8065-f80eb34030a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[53006dee-a7ed-42cc-8d0b-3856ae550839]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:13 devstack sudo[85880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24
Apr 27 15:10:13 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:13 devstack sudo[85878]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1776559d-146f-4bf8-b07e-b12303baab12 1073741824" returned: 0 in 0.757s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:13 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24" returned: 0 in 0.672s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3186f8-b5af-4314-8065-f80eb34030a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1776559d-146f-4bf8-b07e-b12303baab12 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:13 devstack sudo[85896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b
Apr 27 15:10:13 devstack sudo[85896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:13 devstack sudo[85898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1776559d-146f-4bf8-b07e-b12303baab12
Apr 27 15:10:13 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:14 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ce6634eb-75e5-4275-bd39-dac3e2badf32 tempest-VolumesTransfersV355Test-1156359983 None] Transfer volume completed successfully.
Apr 27 15:10:14 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1776559d-146f-4bf8-b07e-b12303baab12" returned: 0 in 0.823s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:10:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cebb4f-85ac-469c-a65b-3c31dcdd4345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1776559d-146f-4bf8-b07e-b12303baab12', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26c6def-8b74-481c-ad92-a9d4c9b5be35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:14 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Volume volume-1776559d-146f-4bf8-b07e-b12303baab12 (1776559d-146f-4bf8-b07e-b12303baab12): created successfully
Apr 27 15:10:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26c6def-8b74-481c-ad92-a9d4c9b5be35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Flow 'volume_create_manager' (15e759f4-acda-44f7-bd07-85a580255abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:14 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-38e9074b-890a-4df4-9eac-ba80244a8ee1 tempest-VolumeQuotasAdminTestJSON-435252041 None] Created volume successfully.
Apr 27 15:10:14 devstack sudo[85896]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b" returned: 0 in 1.022s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:14 devstack sudo[85946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b
Apr 27 15:10:14 devstack sudo[85946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:15 devstack sudo[85946]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.9a8f2c2f-657b-467f-b802-7b3184d6504b" returned: 0 in 0.572s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-9a8f2c2f-657b-467f-b802-7b3184d6504b" released by "_delete_snapshot" :: held 3.012s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" released by "delete_snapshot" :: held 3.049s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:15 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Created reservations ['3556e388-9b22-4b05-ad10-0cc7082c97b0', 'bfcc63ff-3d04-4c17-8fe6-8934273291b2', '021096fb-589f-4089-9821-cc512aa975d9', '2a785342-d51c-4f3a-ac33-10b58538127c'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Acquiring lock "cinder-eb861fdb-5c29-4686-89b1-ef75d923a80c-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Lock "cinder-eb861fdb-5c29-4686-89b1-ef75d923a80c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:15 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Delete snapshot completed successfully.
Apr 27 15:10:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Acquiring lock "cinder-quobyte-eb861fdb-5c29-4686-89b1-ef75d923a80c" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-453cc4d1-acdd-43c4-aba4-aff27a900efc tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-9a8f2c2f-657b-467f-b802-7b3184d6504b-delete_snapshot" released by "delete_snapshot" :: held 3.291s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Lock "cinder-quobyte-eb861fdb-5c29-4686-89b1-ef75d923a80c" acquired by "delete_volume" :: waited 0.032s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:15 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c067e600-472d-4ead-bef2-7a9fc7db088c]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-eb861fdb-5c29-4686-89b1-ef75d923a80c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:15 devstack sudo[85950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-eb861fdb-5c29-4686-89b1-ef75d923a80c
Apr 27 15:10:15 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:16 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-7352dfd0-c7f4-4589-b098-1f5d74e9574c tempest-VolumeQuotasAdminTestJSON-2135699997 None] Transfer volume completed successfully.
Apr 27 15:10:16 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-eb861fdb-5c29-4686-89b1-ef75d923a80c" returned: 0 in 0.784s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-eb861fdb-5c29-4686-89b1-ef75d923a80c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:16 devstack sudo[85957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-eb861fdb-5c29-4686-89b1-ef75d923a80c
Apr 27 15:10:16 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] Creating offline snapshot 266ca38a-1e0e-4162-9bf2-38c8496dc52a of volume ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cf6a03-7d74-464f-a22c-a6171bdd32f6]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:17 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-eb861fdb-5c29-4686-89b1-ef75d923a80c" returned: 0 in 0.808s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Lock "cinder-quobyte-eb861fdb-5c29-4686-89b1-ef75d923a80c" released by "delete_volume" :: held 1.643s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:17 devstack sudo[85960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24
Apr 27 15:10:17 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Acquiring lock "cinder-1776559d-146f-4bf8-b07e-b12303baab12-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Created reservations ['61b42c2e-4b84-498e-a43f-c728c146d5e8', '29e64370-b78e-4601-a586-d968939edb8c', 'a91aedaa-707c-4ca8-a551-e0b28e17478b', 'df060b42-6133-4dc6-8a64-499506d62e7e'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Lock "cinder-1776559d-146f-4bf8-b07e-b12303baab12-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Acquiring lock "cinder-quobyte-1776559d-146f-4bf8-b07e-b12303baab12" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Lock "cinder-quobyte-1776559d-146f-4bf8-b07e-b12303baab12" acquired by "delete_volume" :: waited 0.059s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:17 devstack sudo[85966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:10:17 devstack sudo[85966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2014c0-e95c-4560-8dcc-47b2eadd0f80]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1776559d-146f-4bf8-b07e-b12303baab12 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:17 devstack sudo[85969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1776559d-146f-4bf8-b07e-b12303baab12
Apr 27 15:10:17 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:18 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24" returned: 0 in 1.152s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3186f8-b5af-4314-8065-f80eb34030a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:18 devstack sudo[85991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a 1G
Apr 27 15:10:18 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Flow 'volume_create_manager' (37977eba-7f3d-4394-b956-bad90c0c432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a495d3-c322-49c1-9a4d-b2ab050cd576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:18 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a495d3-c322-49c1-9a4d-b2ab050cd576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2145890790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d8981c-5825-4778-a7d7-c8b814c3a2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093ad11ee8a3458c874e121112722e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:19Z,use_quota=True,user_id='1531272ff22b4a5b8b8f81e6e1d39b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24964f3-46e2-4e17-9302-fdb51880a798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24964f3-46e2-4e17-9302-fdb51880a798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ce3419-b409-4d0d-83ab-342bad551dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:18 devstack sudo[85966]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ce3419-b409-4d0d-83ab-342bad551dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d8981c-5825-4778-a7d7-c8b814c3a2ba', 'volume_name': 'volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d1144b-18d7-4dc9-8089-58866d496693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d1144b-18d7-4dc9-8089-58866d496693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa569cd-3362-46f8-b212-4806dd902b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:18 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Volume c5d8981c-5825-4778-a7d7-c8b814c3a2ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba', 'volume_size': 1}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1776559d-146f-4bf8-b07e-b12303baab12" returned: 0 in 1.129s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1776559d-146f-4bf8-b07e-b12303baab12 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 1.198s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:10:18 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Deleted volume successfully.
Apr 27 15:10:18 devstack sudo[86000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1776559d-146f-4bf8-b07e-b12303baab12
Apr 27 15:10:18 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:18 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-eb6ec49c-21ee-4086-b4ce-11e41caf81ca tempest-VolumesTransfersV355Test-625012033 None] Lock "cinder-eb861fdb-5c29-4686-89b1-ef75d923a80c-delete_volume" released by "delete_volume" :: held 3.240s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:19 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a 1G" returned: 0 in 0.900s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:19 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1776559d-146f-4bf8-b07e-b12303baab12" returned: 0 in 0.508s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:19 devstack sudo[86009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a
Apr 27 15:10:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Lock "cinder-quobyte-1776559d-146f-4bf8-b07e-b12303baab12" released by "delete_volume" :: held 1.689s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:19 devstack sudo[86009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:19 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Created reservations ['21fe6204-6d7c-496b-b919-cdddf9bdfb0e', '4503ec69-0a64-4341-8ef6-21a7d369a422', '0da254cc-8e78-41c8-8399-b146da5fb312', 'b5933ec0-62b5-41c0-8676-1b4d1e34652e'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:19 devstack sudo[86011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:10:19 devstack sudo[86011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:20 devstack sudo[86009]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a" returned: 0 in 0.655s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:20 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a is being set with open permissions: ugo+rw
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:20 devstack sudo[86016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a
Apr 27 15:10:20 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:20 devstack sudo[86011]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.673s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:10:20 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Deleted volume successfully.
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-204de8c6-af51-47ee-94e6-50e7e2219d30 tempest-VolumeQuotasAdminTestJSON-8898115 None] Lock "cinder-1776559d-146f-4bf8-b07e-b12303baab12-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:20 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a" returned: 0 in 0.641s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.468s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.826s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2145890790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d8981c-5825-4778-a7d7-c8b814c3a2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093ad11ee8a3458c874e121112722e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:19Z,use_quota=True,user_id='1531272ff22b4a5b8b8f81e6e1d39b3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Creating volume c5d8981c-5825-4778-a7d7-c8b814c3a2ba {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:10:20 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:10:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:20 devstack sudo[86023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba 1073741824
Apr 27 15:10:20 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:20 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-d2c69996-a4b4-44e7-a8ed-f241c396f0f8 tempest-SnapshotsActionsTest-416904391 None] Create snapshot completed successfully
Apr 27 15:10:21 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba 1073741824" returned: 0 in 0.697s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:21 devstack sudo[86028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba
Apr 27 15:10:21 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:21 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-c7980740-f07f-4aea-ae91-1f0559595266 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Terminate volume connection completed successfully.
Apr 27 15:10:21 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-c7980740-f07f-4aea-ae91-1f0559595266 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Deleting attachment 545c4e4a-7a76-46f4-8772-d92175ef03d4. {{(pid=81538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 27 15:10:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Acquiring lock "cinder-266ca38a-1e0e-4162-9bf2-38c8496dc52a-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-266ca38a-1e0e-4162-9bf2-38c8496dc52a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Acquiring lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Acquiring lock "cinder-quobyte-266ca38a-1e0e-4162-9bf2-38c8496dc52a" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-266ca38a-1e0e-4162-9bf2-38c8496dc52a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:21 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Deleting offline snapshot 266ca38a-1e0e-4162-9bf2-38c8496dc52a of volume ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:10:21 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] snapshot_file for this snap is: volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:10:21 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d16fe51-cf61-4105-9c68-ac2f0dc6d324]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:21 devstack sudo[86030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a
Apr 27 15:10:21 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:22 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba" returned: 0 in 0.559s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa569cd-3362-46f8-b212-4806dd902b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6721bc-a8c9-473d-b856-2879f47138eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:22 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Volume volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba (c5d8981c-5825-4778-a7d7-c8b814c3a2ba): created successfully
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6721bc-a8c9-473d-b856-2879f47138eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Flow 'volume_create_manager' (37977eba-7f3d-4394-b956-bad90c0c432a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:22 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e9ddd71d-b361-4800-8747-9579aa120da7 tempest-VolumesTransfersV355Test-82492785 None] Created volume successfully.
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Acquiring lock "cinder-4d362179-7c7f-4c77-bd46-ebe356ea1662-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "cinder-4d362179-7c7f-4c77-bd46-ebe356ea1662-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Acquiring lock "cinder-quobyte-4d362179-7c7f-4c77-bd46-ebe356ea1662" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "cinder-quobyte-4d362179-7c7f-4c77-bd46-ebe356ea1662" acquired by "delete_volume" :: waited 0.033s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[754679db-d102-4a17-8b7e-0d93f7d34aef]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:22 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a" returned: 0 in 0.779s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:22 devstack sudo[86036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3186f8-b5af-4314-8065-f80eb34030a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:10:22 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d1e3b5-4f6c-4b62-b6fd-266501227ca6]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:22 devstack sudo[86039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24
Apr 27 15:10:22 devstack sudo[86039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:23 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662" returned: 0 in 0.615s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:23 devstack sudo[86043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662
Apr 27 15:10:23 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:23 devstack sudo[86039]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24" returned: 0 in 0.728s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:23 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3186f8-b5af-4314-8065-f80eb34030a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:10:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:23 devstack sudo[86048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a
Apr 27 15:10:23 devstack sudo[86048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Acquiring lock "cinder-c5d8981c-5825-4778-a7d7-c8b814c3a2ba-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Lock "cinder-c5d8981c-5825-4778-a7d7-c8b814c3a2ba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Acquiring lock "cinder-quobyte-c5d8981c-5825-4778-a7d7-c8b814c3a2ba" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Lock "cinder-quobyte-c5d8981c-5825-4778-a7d7-c8b814c3a2ba" acquired by "delete_volume" :: waited 0.056s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:23 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1b4a37-16a3-4b5d-a4db-d3206de98de3]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:23 devstack sudo[86050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba
Apr 27 15:10:23 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:23 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662" returned: 1 in 0.872s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:10:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:24 devstack sudo[86058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662
Apr 27 15:10:24 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:24 devstack sudo[86048]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a" returned: 0 in 0.884s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:24 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:24 devstack sudo[86063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a
Apr 27 15:10:24 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba" returned: 0 in 0.629s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:24 devstack sudo[86065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba
Apr 27 15:10:24 devstack sudo[86065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:24 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4d362179-7c7f-4c77-bd46-ebe356ea1662" returned: 0 in 0.586s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "cinder-quobyte-4d362179-7c7f-4c77-bd46-ebe356ea1662" released by "delete_volume" :: held 2.154s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG cinder.quota [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Created reservations ['d48b61e4-5655-4731-b5e9-ca8ce53e8395', 'dc69457c-0cf4-48b1-b7c2-aa166c01d078', '4b9f412c-9379-418b-8f98-1ec8e0d5fb14', '9bbbf0f9-d0bc-4733-902f-a817ebefb89c'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:24 devstack sudo[86068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:10:24 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:24 devstack sudo[86065]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c5d8981c-5825-4778-a7d7-c8b814c3a2ba" returned: 0 in 0.649s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:24 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.266ca38a-1e0e-4162-9bf2-38c8496dc52a" returned: 0 in 0.708s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Lock "cinder-quobyte-c5d8981c-5825-4778-a7d7-c8b814c3a2ba" released by "delete_volume" :: held 1.350s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-266ca38a-1e0e-4162-9bf2-38c8496dc52a" released by "_delete_snapshot" :: held 3.233s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" released by "delete_snapshot" :: held 3.273s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Created reservations ['3aa172f7-37d8-407a-8cea-74419b4d3529', 'f3cd71f9-70ee-40f8-b8ba-e599ab3a0d2f', '412971f2-365d-451f-a6c8-2e4faf4a1c04', 'ab427db8-2e4c-4af3-96ba-024152eb2f5a'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Created reservations ['a1a54314-eee1-49bb-9910-f131a3cbc92d', 'c6379d42-9de6-4ec7-96d1-318d8d4c9016', 'a7bce68c-5da0-4f11-be89-23e14785e451', 'c79cc2c0-7318-424e-9df4-f8cc60ce9767'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:25 devstack sudo[86072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:10:25 devstack sudo[86072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:25 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Delete snapshot completed successfully.
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bbeaadfc-71e7-4f3c-ab89-7a8abcbb4ede tempest-SnapshotsActionsTest-1642766560 None] Lock "cinder-266ca38a-1e0e-4162-9bf2-38c8496dc52a-delete_snapshot" released by "delete_snapshot" :: held 3.552s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:25 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.558s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG cinder.manager [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:10:25 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Deleted volume successfully.
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-9b7d751b-84b2-4e96-a3f6-792ff1f31624 req-036ca350-509b-401a-8196-5c4d1d6d4743 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "cinder-4d362179-7c7f-4c77-bd46-ebe356ea1662-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:25 devstack sudo[86072]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.517s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:10:25 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Deleted volume successfully.
Apr 27 15:10:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f8e9f111-be6f-46fb-9987-9d218e979c86 tempest-VolumesTransfersV355Test-625012033 None] Lock "cinder-c5d8981c-5825-4778-a7d7-c8b814c3a2ba-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Acquiring lock "cinder-c93eb6fd-e99c-4a17-8650-cc2374380c24-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Lock "cinder-c93eb6fd-e99c-4a17-8650-cc2374380c24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Acquiring lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Acquiring lock "cinder-quobyte-c93eb6fd-e99c-4a17-8650-cc2374380c24" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Lock "cinder-quobyte-c93eb6fd-e99c-4a17-8650-cc2374380c24" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:26 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Deleting offline snapshot c93eb6fd-e99c-4a17-8650-cc2374380c24 of volume ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:10:26 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] snapshot_file for this snap is: volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:10:26 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dcdd7e-f128-45a5-aa8d-ed6140b5112a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:26 devstack sudo[86077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24
Apr 27 15:10:26 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:27 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24" returned: 0 in 0.666s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3186f8-b5af-4314-8065-f80eb34030a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:10:27 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b90885-bb2f-4a01-b18d-012799b0708f]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:27 devstack sudo[86082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4
Apr 27 15:10:27 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:28 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4" returned: 0 in 0.796s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:28 devstack sudo[86108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24
Apr 27 15:10:28 devstack sudo[86108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:29 devstack sudo[86108]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24" returned: 0 in 0.925s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:29 devstack sudo[86124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24
Apr 27 15:10:29 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:29 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4.c93eb6fd-e99c-4a17-8650-cc2374380c24" returned: 0 in 0.532s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:29 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Lock "cinder-quobyte-c93eb6fd-e99c-4a17-8650-cc2374380c24" released by "_delete_snapshot" :: held 3.094s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:29 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" released by "delete_snapshot" :: held 3.160s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:29 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Created reservations ['44fec84f-2c0f-47a8-b939-ed50884e1bea', 'fcc2690e-5800-4c31-b103-bc6aa841dff0', '43ffbbaf-81ab-4525-9a84-ae0dcfa3b1b2', '0e947ccb-7dbc-4dcd-a30b-870adfa4d2d2'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:29 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Delete snapshot completed successfully.
Apr 27 15:10:29 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62339333-9770-4cef-9814-a07b952dbd8a tempest-SnapshotsActionsTest-416904391 None] Lock "cinder-c93eb6fd-e99c-4a17-8650-cc2374380c24-delete_snapshot" released by "delete_snapshot" :: held 3.359s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Acquiring lock "cinder-ab3186f8-b5af-4314-8065-f80eb34030a4-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Lock "cinder-ab3186f8-b5af-4314-8065-f80eb34030a4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Acquiring lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" acquired by "delete_volume" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:30 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[98887d36-f944-4f9f-a987-80f2018d6e9e]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:30 devstack sudo[86130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4
Apr 27 15:10:30 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:31 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4" returned: 0 in 0.674s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:31 devstack sudo[86135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4
Apr 27 15:10:31 devstack sudo[86135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:32 devstack sudo[86135]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab3186f8-b5af-4314-8065-f80eb34030a4" returned: 0 in 0.728s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Lock "cinder-quobyte-ab3186f8-b5af-4314-8065-f80eb34030a4" released by "delete_volume" :: held 1.495s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Created reservations ['b1275ee8-1a73-472a-9a47-6b6591f85011', 'ab38ac9d-6200-41b5-af8e-35b9febafdcf', '1abe2cd7-0bf9-4944-b9c6-65bb06115cef', '28ea497b-d722-4cda-b9ac-05b7ef36e25a'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:32 devstack sudo[86138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:10:32 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Flow 'volume_create_manager' (ae5cc410-05e5-4891-b2cf-5bb4ebda4dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4353520-30f0-4282-8b0b-85f336816f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4353520-30f0-4282-8b0b-85f336816f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-406565813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d49d64-b377-43d8-9b84-4f3841ad1acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a7094d37ae4244b6f69556eb35cf52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:33Z,use_quota=True,user_id='00a4c4752eb547b8ac8ec22ad9e065cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfa7039-703a-47f7-ad6a-2a3bf485104d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfa7039-703a-47f7-ad6a-2a3bf485104d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a14db9d-e59c-41a1-bed8-03069398fc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a14db9d-e59c-41a1-bed8-03069398fc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d49d64-b377-43d8-9b84-4f3841ad1acc', 'volume_name': 'volume-24d49d64-b377-43d8-9b84-4f3841ad1acc', 'volume_size': 2}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dafcd19-8320-403a-b7b9-3483ed58d655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dafcd19-8320-403a-b7b9-3483ed58d655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6feab183-a377-4c1b-8724-61187db5f70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:32 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Volume 24d49d64-b377-43d8-9b84-4f3841ad1acc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d49d64-b377-43d8-9b84-4f3841ad1acc', 'volume_size': 2}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-406565813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d49d64-b377-43d8-9b84-4f3841ad1acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a7094d37ae4244b6f69556eb35cf52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:33Z,use_quota=True,user_id='00a4c4752eb547b8ac8ec22ad9e065cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Creating volume 24d49d64-b377-43d8-9b84-4f3841ad1acc {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:10:32 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:10:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc 2147483648 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:32 devstack sudo[86140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc 2147483648
Apr 27 15:10:32 devstack sudo[86140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:33 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.602s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:33 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:10:33 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Deleted volume successfully.
Apr 27 15:10:33 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d32809bd-68e4-4cc8-9af1-ca5819b143f8 tempest-SnapshotsActionsTest-416904391 None] Lock "cinder-ab3186f8-b5af-4314-8065-f80eb34030a4-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:33 devstack sudo[86140]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc 2147483648" returned: 0 in 0.892s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:33 devstack sudo[86152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc
Apr 27 15:10:33 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:34 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc" returned: 0 in 0.640s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:34 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:10:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6feab183-a377-4c1b-8724-61187db5f70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d49d64-b377-43d8-9b84-4f3841ad1acc', 'volume_size': 2}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48761ea1-b31d-4d30-839a-228171f971f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:34 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Volume volume-24d49d64-b377-43d8-9b84-4f3841ad1acc (24d49d64-b377-43d8-9b84-4f3841ad1acc): created successfully
Apr 27 15:10:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48761ea1-b31d-4d30-839a-228171f971f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Flow 'volume_create_manager' (ae5cc410-05e5-4891-b2cf-5bb4ebda4dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:34 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f1484d09-e3f9-4e89-91d4-a447f94c7ea4 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Created volume successfully.
Apr 27 15:10:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Creating offline snapshot 83a4152c-d3a0-4ab7-aa3b-cdff7775f366 of volume 24d49d64-b377-43d8-9b84-4f3841ad1acc {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:10:35 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[593ba729-eb98-469b-89d6-c22e493dcb48]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:35 devstack sudo[86167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc
Apr 27 15:10:35 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:36 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc" returned: 0 in 0.959s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366 2G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:36 devstack sudo[86186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366 2G
Apr 27 15:10:36 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:37 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366 2G" returned: 0 in 0.827s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d49d64-b377-43d8-9b84-4f3841ad1acc -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:37 devstack sudo[86193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d49d64-b377-43d8-9b84-4f3841ad1acc -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366
Apr 27 15:10:37 devstack sudo[86193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:37 devstack sudo[86193]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d49d64-b377-43d8-9b84-4f3841ad1acc -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366" returned: 0 in 0.635s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:37 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366 is being set with open permissions: ugo+rw
Apr 27 15:10:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:37 devstack sudo[86200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366
Apr 27 15:10:37 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:38 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366" returned: 0 in 0.533s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:38 devstack sudo[86206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.info
Apr 27 15:10:38 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:38 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-36dbf22e-4181-4667-bedf-540866eac392 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Terminate volume connection completed successfully.
Apr 27 15:10:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-36dbf22e-4181-4667-bedf-540866eac392 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Deleting attachment f9b04b06-7d3e-496f-9044-3b4f8f1ce8b8. {{(pid=81538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 27 15:10:38 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.info" returned: 0 in 0.613s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:38 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.info is being set with open permissions: ugo+rw
Apr 27 15:10:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:38 devstack sudo[86209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.info
Apr 27 15:10:38 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Acquiring lock "cinder-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "cinder-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Acquiring lock "cinder-quobyte-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "cinder-quobyte-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6" acquired by "delete_volume" :: waited 0.035s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:39 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d057d5-a0c3-4910-afc9-4f6bededfc88]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:39 devstack sudo[86211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6
Apr 27 15:10:39 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:39 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.info" returned: 0 in 0.665s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.375s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-8f2032a8-cdeb-46db-9796-aeaec09f7f1b tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Create snapshot completed successfully
Apr 27 15:10:39 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Flow 'volume_create_manager' (30271a94-4616-4002-bf77-f3c7c6ef5d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d31edf-88ba-4cef-bc91-0e45db5dd7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d31edf-88ba-4cef-bc91-0e45db5dd7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1612302470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0b7d30-8ec7-494f-aed6-36c1980110d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1797375ffc6442bf8d436b39460b403e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:40Z,use_quota=True,user_id='4876b203fdea4c85851b93587581d8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82347dbc-2789-41c5-8d5a-d45c3f4ab1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82347dbc-2789-41c5-8d5a-d45c3f4ab1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81973c2a-df25-4fa0-99a9-78982f10f1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81973c2a-df25-4fa0-99a9-78982f10f1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b0b7d30-8ec7-494f-aed6-36c1980110d3', 'volume_name': 'volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700136b8-25a7-41fd-ad7d-9bde26ba15d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700136b8-25a7-41fd-ad7d-9bde26ba15d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f43055-73ee-414f-9b9b-37eb577f7158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:40 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Volume 0b0b7d30-8ec7-494f-aed6-36c1980110d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3', 'volume_size': 1}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1612302470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0b7d30-8ec7-494f-aed6-36c1980110d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1797375ffc6442bf8d436b39460b403e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:40Z,use_quota=True,user_id='4876b203fdea4c85851b93587581d8aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Creating volume 0b0b7d30-8ec7-494f-aed6-36c1980110d3 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:10:40 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:40 devstack sudo[86218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3 1073741824
Apr 27 15:10:40 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:40 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6" returned: 0 in 0.909s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:40 devstack sudo[86220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6
Apr 27 15:10:40 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Acquiring lock "cinder-83a4152c-d3a0-4ab7-aa3b-cdff7775f366-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "cinder-83a4152c-d3a0-4ab7-aa3b-cdff7775f366-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Acquiring lock "cinder-quobyte-24d49d64-b377-43d8-9b84-4f3841ad1acc" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "cinder-quobyte-24d49d64-b377-43d8-9b84-4f3841ad1acc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Acquiring lock "cinder-quobyte-83a4152c-d3a0-4ab7-aa3b-cdff7775f366" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "cinder-quobyte-83a4152c-d3a0-4ab7-aa3b-cdff7775f366" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Deleting offline snapshot 83a4152c-d3a0-4ab7-aa3b-cdff7775f366 of volume 24d49d64-b377-43d8-9b84-4f3841ad1acc {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] snapshot_file for this snap is: volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3c5bb2-5040-491f-a7da-2276ece05f74]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:40 devstack sudo[86222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366
Apr 27 15:10:40 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:41 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6" returned: 0 in 0.848s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "cinder-quobyte-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6" released by "delete_volume" :: held 1.815s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG cinder.quota [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Created reservations ['8fef06a2-472e-4aa0-a5db-d95d76c92627', '6705b3fa-13b2-4e0e-80f0-795e4963ab54', '8fde17ef-a1ba-44ed-b082-34b60172c349', '2ea259fc-541e-4b25-938f-75dab9aa33ac'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:41 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3 1073741824" returned: 0 in 1.083s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:41 devstack sudo[86228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3
Apr 27 15:10:41 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:41 devstack sudo[86232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:10:41 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:41 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366" returned: 0 in 0.940s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24d49d64-b377-43d8-9b84-4f3841ad1acc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f309b3-1eb3-4e2e-9536-2cf2a8d31c1c]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:41 devstack sudo[86235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc
Apr 27 15:10:41 devstack sudo[86235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:42 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3" returned: 0 in 0.771s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:10:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f43055-73ee-414f-9b9b-37eb577f7158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cba156-a989-4412-985a-4bea70e90b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:42 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Volume volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3 (0b0b7d30-8ec7-494f-aed6-36c1980110d3): created successfully
Apr 27 15:10:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cba156-a989-4412-985a-4bea70e90b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Flow 'volume_create_manager' (30271a94-4616-4002-bf77-f3c7c6ef5d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:42 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e60d2f4f-8c74-4189-bf9a-e88dc747abdc tempest-VolumesServicesTestJSON-136657761 None] Created volume successfully.
Apr 27 15:10:42 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.857s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:42 devstack cinder-volume[81538]: DEBUG cinder.manager [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:10:42 devstack cinder-volume[81538]: INFO cinder.volume.manager [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Deleted volume successfully.
Apr 27 15:10:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [req-f05af91e-2112-4f6c-b8e0-5135edabd355 req-56cb05d9-7e2c-4bd8-9913-5fe565ef21d8 tempest-ServerBootFromVolumeStableRescueTest-1090620844 None] Lock "cinder-467a7a5c-40d1-4d3b-afdb-4bb63800e9a6-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:42 devstack sudo[86235]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc" returned: 0 in 0.997s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:42 devstack sudo[86242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366
Apr 27 15:10:42 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:43 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366" returned: 0 in 0.769s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:43 devstack sudo[86248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366
Apr 27 15:10:43 devstack sudo[86248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Acquiring lock "cinder-0b0b7d30-8ec7-494f-aed6-36c1980110d3-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Lock "cinder-0b0b7d30-8ec7-494f-aed6-36c1980110d3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Acquiring lock "cinder-quobyte-0b0b7d30-8ec7-494f-aed6-36c1980110d3" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Lock "cinder-quobyte-0b0b7d30-8ec7-494f-aed6-36c1980110d3" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:43 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30e1890-2386-475a-ae88-259931cd8726]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:43 devstack sudo[86251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3
Apr 27 15:10:43 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:44 devstack sudo[86248]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc.83a4152c-d3a0-4ab7-aa3b-cdff7775f366" returned: 0 in 0.705s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "cinder-quobyte-83a4152c-d3a0-4ab7-aa3b-cdff7775f366" released by "_delete_snapshot" :: held 3.605s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "cinder-quobyte-24d49d64-b377-43d8-9b84-4f3841ad1acc" released by "delete_snapshot" :: held 3.653s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:44 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Created reservations ['4101448e-abce-4708-99cd-3e32eb0aff0a', '9ffe53f9-6830-4c58-bdf5-73971ff97813', 'f57328f8-da51-4dc4-b6be-e8edefa1b793', '77ae2c8d-e83c-44a7-a1f9-56679c095fe6'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:44 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Delete snapshot completed successfully.
Apr 27 15:10:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b2818dca-e6df-4d05-acb1-f719fb9baae2 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "cinder-83a4152c-d3a0-4ab7-aa3b-cdff7775f366-delete_snapshot" released by "delete_snapshot" :: held 3.890s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:44 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3" returned: 0 in 0.847s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:44 devstack sudo[86263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3
Apr 27 15:10:44 devstack sudo[86263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Acquiring lock "cinder-24d49d64-b377-43d8-9b84-4f3841ad1acc-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "cinder-24d49d64-b377-43d8-9b84-4f3841ad1acc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Acquiring lock "cinder-quobyte-24d49d64-b377-43d8-9b84-4f3841ad1acc" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "cinder-quobyte-24d49d64-b377-43d8-9b84-4f3841ad1acc" acquired by "delete_volume" :: waited 0.028s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aecdee1-9cbd-41ae-995d-12028c923d0b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:45 devstack sudo[86280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc
Apr 27 15:10:45 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:45 devstack sudo[86263]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b0b7d30-8ec7-494f-aed6-36c1980110d3" returned: 0 in 0.809s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Lock "cinder-quobyte-0b0b7d30-8ec7-494f-aed6-36c1980110d3" released by "delete_volume" :: held 1.711s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Created reservations ['070abb6a-802b-4d02-8d9a-c860b8b2463f', '0f8a7b58-fb4d-4e58-a553-884b91c4ed64', '55e45d9f-bc8f-439b-8c4a-d4b75b293364', '80fce022-f2d5-4306-bc10-c18b358fe3ab'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:45 devstack sudo[86299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:10:45 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:45 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc" returned: 0 in 0.724s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:45 devstack sudo[86304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc
Apr 27 15:10:45 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:46 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.563s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:46 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:10:46 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Deleted volume successfully.
Apr 27 15:10:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f8707bcc-56be-43e2-afae-33fb0c81f6f5 tempest-VolumesServicesTestJSON-136657761 None] Lock "cinder-0b0b7d30-8ec7-494f-aed6-36c1980110d3-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:46 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-24d49d64-b377-43d8-9b84-4f3841ad1acc" returned: 0 in 0.663s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "cinder-quobyte-24d49d64-b377-43d8-9b84-4f3841ad1acc" released by "delete_volume" :: held 1.454s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:46 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Created reservations ['950bc0d3-6948-4b85-9221-d53a0a3aa84c', 'ca3e34e4-c215-4445-bb04-d20d5f883277', '5416ade9-5d08-4f5b-bf8d-62d7649defff', 'ed101b12-8be0-4f6c-a22a-fed3e6af5557'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:10:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:46 devstack sudo[86309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:10:46 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:47 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.638s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:47 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:10:47 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Deleted volume successfully.
Apr 27 15:10:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-def72352-b231-4ab7-8e14-fceac7976a91 tempest-VolumesSnapshotNegativeTestJSON-1788979705 None] Lock "cinder-24d49d64-b377-43d8-9b84-4f3841ad1acc-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:10:48 devstack cinder-volume[81538]: DEBUG oslo_service.periodic_task [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81538) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:10:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:48 devstack sudo[86314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:10:48 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:49 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.620s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:49 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Flow 'volume_create_manager' (0d062895-b893-4b24-a538-75e71590cec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdb7ad1-e3e3-4190-a555-0fd64bb2c487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bdb7ad1-e3e3-4190-a555-0fd64bb2c487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-565826883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9431e2-adaa-4901-a3df-f0022f4bf51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d23102c6b3a4eaeb3c048f9f6cfb7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:51Z,use_quota=True,user_id='60b24e2e2873405191c12fb7e14501bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddea1e56-60e2-423b-a687-c76fc806e7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddea1e56-60e2-423b-a687-c76fc806e7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa996f93-aab5-44a3-a171-fad37def319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa996f93-aab5-44a3-a171-fad37def319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f9431e2-adaa-4901-a3df-f0022f4bf51f', 'volume_name': 'volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9927b13d-ddfe-4023-b536-c81a999cc010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9927b13d-ddfe-4023-b536-c81a999cc010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8d6e09-7350-4e7d-bd24-bd2cbc12577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:51 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Volume 3f9431e2-adaa-4901-a3df-f0022f4bf51f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f', 'volume_size': 1}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-565826883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9431e2-adaa-4901-a3df-f0022f4bf51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d23102c6b3a4eaeb3c048f9f6cfb7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:51Z,use_quota=True,user_id='60b24e2e2873405191c12fb7e14501bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Creating volume 3f9431e2-adaa-4901-a3df-f0022f4bf51f {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:10:51 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:51 devstack sudo[86317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f 1073741824
Apr 27 15:10:51 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:51 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Flow 'volume_create_manager' (57f824e5-8339-45dc-a5d6-a8d0e375e5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632b8235-ed86-499e-a44a-e8a23f926e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632b8235-ed86-499e-a44a-e8a23f926e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1288968630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1a8b22-bcd7-42c7-9a9c-fc195760302f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d23102c6b3a4eaeb3c048f9f6cfb7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:52Z,use_quota=True,user_id='60b24e2e2873405191c12fb7e14501bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8ba4df-c317-47c7-83a6-5345af2bfb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8ba4df-c317-47c7-83a6-5345af2bfb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0699565f-e706-4e72-82f8-60fcaea0eafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0699565f-e706-4e72-82f8-60fcaea0eafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e1a8b22-bcd7-42c7-9a9c-fc195760302f', 'volume_name': 'volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335a6ec1-438a-479f-b0fb-a649e9176c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335a6ec1-438a-479f-b0fb-a649e9176c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b0cad9-ed6b-47d3-b45e-b7684ddd28f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:52 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Volume 5e1a8b22-bcd7-42c7-9a9c-fc195760302f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f', 'volume_size': 1}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Flow 'volume_create_manager' (f4af1257-49de-42e0-a753-7a0a1ea1e7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188edaa4-d45f-4292-a1c1-5aed5f294494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188edaa4-d45f-4292-a1c1-5aed5f294494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-848726059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee7b9dd-4fd6-40a5-82c3-34989ba97197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d23102c6b3a4eaeb3c048f9f6cfb7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:53Z,use_quota=True,user_id='60b24e2e2873405191c12fb7e14501bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c7718b-a39c-47e1-9195-cc9a089b89e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c7718b-a39c-47e1-9195-cc9a089b89e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021f3d86-28e1-4aaf-8780-32d7267e8597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021f3d86-28e1-4aaf-8780-32d7267e8597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee7b9dd-4fd6-40a5-82c3-34989ba97197', 'volume_name': 'volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fbdc86-0a8a-429d-89b1-3099921d15f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fbdc86-0a8a-429d-89b1-3099921d15f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9faf6f15-882a-4a40-9b28-3632ce1d6190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:52 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Volume 8ee7b9dd-4fd6-40a5-82c3-34989ba97197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197', 'volume_size': 1}
Apr 27 15:10:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Flow 'volume_create_manager' (452b1f09-69df-44bc-bd52-7aab072b1726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e745f1-a3fb-46e9-827d-1c056a73003a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e745f1-a3fb-46e9-827d-1c056a73003a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-359685625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f954aae9-2ca8-4231-9581-340f62deca5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d23102c6b3a4eaeb3c048f9f6cfb7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:53Z,use_quota=True,user_id='60b24e2e2873405191c12fb7e14501bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31485ef-01d0-4cde-9663-c0e4c1376aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31485ef-01d0-4cde-9663-c0e4c1376aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac71fb5-7b93-4354-af8e-5dd0b35ce044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac71fb5-7b93-4354-af8e-5dd0b35ce044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f954aae9-2ca8-4231-9581-340f62deca5b', 'volume_name': 'volume-f954aae9-2ca8-4231-9581-340f62deca5b', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fdd3ea1-4591-4c0d-880b-2dee20309610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fdd3ea1-4591-4c0d-880b-2dee20309610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff901245-7f53-41c4-86fb-de4bef82549a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:53 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Volume f954aae9-2ca8-4231-9581-340f62deca5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f954aae9-2ca8-4231-9581-340f62deca5b', 'volume_size': 1}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:53 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f 1073741824" returned: 0 in 1.629s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:53 devstack sudo[86323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f
Apr 27 15:10:53 devstack sudo[86323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Flow 'volume_create_manager' (d6fc01e2-be55-4822-92a6-ba63001503f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82ae793-4e0e-4954-96dc-aa005a7a8e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82ae793-4e0e-4954-96dc-aa005a7a8e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-246505007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f91bf9-591a-4cdf-8c15-d7a9c6e61cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d23102c6b3a4eaeb3c048f9f6cfb7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:54Z,use_quota=True,user_id='60b24e2e2873405191c12fb7e14501bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f187cb-e65a-4af0-887c-4046a5ea16ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f187cb-e65a-4af0-887c-4046a5ea16ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7254d001-4f0b-4f39-9e3a-4df145c63c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7254d001-4f0b-4f39-9e3a-4df145c63c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83f91bf9-591a-4cdf-8c15-d7a9c6e61cff', 'volume_name': 'volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5379757-610d-490c-aa46-7e03a671d80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5379757-610d-490c-aa46-7e03a671d80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b1b1c5-3f8e-4b5e-b5c4-250e12edf0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:53 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Volume 83f91bf9-591a-4cdf-8c15-d7a9c6e61cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff', 'volume_size': 1}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:53 devstack sudo[86323]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f" returned: 0 in 0.667s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] <== create_volume: return (2352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.355s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.848s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1288968630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1a8b22-bcd7-42c7-9a9c-fc195760302f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d23102c6b3a4eaeb3c048f9f6cfb7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:52Z,use_quota=True,user_id='60b24e2e2873405191c12fb7e14501bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Creating volume 5e1a8b22-bcd7-42c7-9a9c-fc195760302f {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:10:53 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8d6e09-7350-4e7d-bd24-bd2cbc12577c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:53 devstack sudo[86327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f 1073741824
Apr 27 15:10:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2956c856-31f6-45cd-a342-5839e8ee6a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:53 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:54 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Volume volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f (3f9431e2-adaa-4901-a3df-f0022f4bf51f): created successfully
Apr 27 15:10:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2956c856-31f6-45cd-a342-5839e8ee6a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Flow 'volume_create_manager' (0d062895-b893-4b24-a538-75e71590cec9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:54 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-6ebd32bf-9cb5-48e6-999c-8e98cca90c2a tempest-CreateVolumesFromImageTest-1255347 None] Created volume successfully.
Apr 27 15:10:54 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f 1073741824" returned: 0 in 0.833s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:54 devstack sudo[86332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f
Apr 27 15:10:54 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:55 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f" returned: 0 in 0.551s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.631s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-848726059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee7b9dd-4fd6-40a5-82c3-34989ba97197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d23102c6b3a4eaeb3c048f9f6cfb7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:53Z,use_quota=True,user_id='60b24e2e2873405191c12fb7e14501bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Creating volume 8ee7b9dd-4fd6-40a5-82c3-34989ba97197 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:10:55 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:55 devstack sudo[86335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197 1073741824
Apr 27 15:10:55 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b0cad9-ed6b-47d3-b45e-b7684ddd28f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c1de2e-6d2d-4c26-93f0-f89f5def77e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:55 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Volume volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f (5e1a8b22-bcd7-42c7-9a9c-fc195760302f): created successfully
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c1de2e-6d2d-4c26-93f0-f89f5def77e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Flow 'volume_create_manager' (57f824e5-8339-45dc-a5d6-a8d0e375e5b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:55 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-0042288a-966e-44c0-ba2c-8938d59c1844 tempest-CreateVolumesFromImageTest-1255347 None] Created volume successfully.
Apr 27 15:10:56 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197 1073741824" returned: 0 in 0.881s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:56 devstack sudo[86340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197
Apr 27 15:10:56 devstack sudo[86340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:56 devstack sudo[86340]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197" returned: 0 in 0.541s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.680s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-359685625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f954aae9-2ca8-4231-9581-340f62deca5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d23102c6b3a4eaeb3c048f9f6cfb7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:53Z,use_quota=True,user_id='60b24e2e2873405191c12fb7e14501bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Creating volume f954aae9-2ca8-4231-9581-340f62deca5b {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:10:56 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f954aae9-2ca8-4231-9581-340f62deca5b 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9faf6f15-882a-4a40-9b28-3632ce1d6190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2fa762-cfa6-494f-89c8-2d1ee61e2066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:56 devstack sudo[86345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f954aae9-2ca8-4231-9581-340f62deca5b 1073741824
Apr 27 15:10:56 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:56 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Volume volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197 (8ee7b9dd-4fd6-40a5-82c3-34989ba97197): created successfully
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2fa762-cfa6-494f-89c8-2d1ee61e2066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Flow 'volume_create_manager' (f4af1257-49de-42e0-a753-7a0a1ea1e7aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:56 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ae799731-4110-4418-98a6-8fa29087d6b5 tempest-CreateVolumesFromImageTest-1255347 None] Created volume successfully.
Apr 27 15:10:57 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f954aae9-2ca8-4231-9581-340f62deca5b 1073741824" returned: 0 in 0.999s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f954aae9-2ca8-4231-9581-340f62deca5b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:57 devstack sudo[86384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f954aae9-2ca8-4231-9581-340f62deca5b
Apr 27 15:10:57 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:58 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f954aae9-2ca8-4231-9581-340f62deca5b" returned: 0 in 0.675s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.925s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-246505007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f91bf9-591a-4cdf-8c15-d7a9c6e61cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d23102c6b3a4eaeb3c048f9f6cfb7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:10:54Z,use_quota=True,user_id='60b24e2e2873405191c12fb7e14501bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Creating volume 83f91bf9-591a-4cdf-8c15-d7a9c6e61cff {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:10:58 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff901245-7f53-41c4-86fb-de4bef82549a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f954aae9-2ca8-4231-9581-340f62deca5b', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ff9e71-0900-42c1-9a22-e87836726b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:10:58 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Volume volume-f954aae9-2ca8-4231-9581-340f62deca5b (f954aae9-2ca8-4231-9581-340f62deca5b): created successfully
Apr 27 15:10:58 devstack sudo[86389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff 1073741824
Apr 27 15:10:58 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ff9e71-0900-42c1-9a22-e87836726b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:10:58 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Flow 'volume_create_manager' (452b1f09-69df-44bc-bd52-7aab072b1726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:10:58 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ac38c69b-d27a-452f-85ee-8c5531fd9274 tempest-CreateVolumesFromImageTest-1255347 None] Created volume successfully.
Apr 27 15:10:59 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root
Apr 27 15:10:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff 1073741824" returned: 0 in 0.910s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:10:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:10:59 devstack sudo[86394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff
Apr 27 15:10:59 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:00 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff" returned: 0 in 0.599s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:11:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b1b1c5-3f8e-4b5e-b5c4-250e12edf0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f99b166-800c-4900-8caf-1bbd9cce641c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:00 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Volume volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff (83f91bf9-591a-4cdf-8c15-d7a9c6e61cff): created successfully
Apr 27 15:11:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f99b166-800c-4900-8caf-1bbd9cce641c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Flow 'volume_create_manager' (d6fc01e2-be55-4822-92a6-ba63001503f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:00 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-10324f39-afbc-42e9-9d78-36652dad8586 tempest-CreateVolumesFromImageTest-1255347 None] Created volume successfully.
Apr 27 15:11:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "cinder-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "cinder-quobyte-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-quobyte-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff" acquired by "delete_volume" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:00 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[165bc3b1-2a09-43f5-b608-926734e603d1]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:00 devstack sudo[86402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff
Apr 27 15:11:00 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:01 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff" returned: 0 in 0.708s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:01 devstack sudo[86407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff
Apr 27 15:11:01 devstack sudo[86407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:01 devstack sudo[86407]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff" returned: 0 in 0.622s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-quobyte-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff" released by "delete_volume" :: held 1.393s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:01 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:INSERT=39,cinder:UPDATE=144,cinder:SELECT=110,cinder:DELETE=10 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:11:01 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=103,cinder:DELETE=14,cinder:UPDATE=141,cinder:INSERT=31 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Created reservations ['467bc15e-a86f-462d-a279-673138244026', '02268ad5-c21b-48ec-a870-6ef09528086f', '60f87f28-2b97-47ab-a26f-f4bfcb13777f', 'a0a516da-21d9-4fd0-8fa3-c06622cc1249'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:02 devstack sudo[86411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:02 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:02 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.581s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:02 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Deleted volume successfully.
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "cinder-f954aae9-2ca8-4231-9581-340f62deca5b-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ab7b6b48-21d6-46ff-84e2-3c88087d31c2 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-83f91bf9-591a-4cdf-8c15-d7a9c6e61cff-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-f954aae9-2ca8-4231-9581-340f62deca5b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "cinder-quobyte-f954aae9-2ca8-4231-9581-340f62deca5b" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-quobyte-f954aae9-2ca8-4231-9581-340f62deca5b" acquired by "delete_volume" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[109ab2f4-5091-42db-9705-d0f4e4e2f820]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f954aae9-2ca8-4231-9581-340f62deca5b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:02 devstack sudo[86414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f954aae9-2ca8-4231-9581-340f62deca5b
Apr 27 15:11:02 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:03 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f954aae9-2ca8-4231-9581-340f62deca5b" returned: 0 in 0.715s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f954aae9-2ca8-4231-9581-340f62deca5b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:03 devstack sudo[86419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f954aae9-2ca8-4231-9581-340f62deca5b
Apr 27 15:11:03 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:04 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f954aae9-2ca8-4231-9581-340f62deca5b" returned: 0 in 0.583s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-quobyte-f954aae9-2ca8-4231-9581-340f62deca5b" released by "delete_volume" :: held 1.344s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:04 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Created reservations ['c98e3ab1-54b5-4b49-a3b3-ab83322ea718', 'df07df51-8343-4835-8f05-0ed7639f266b', 'f1d26b64-6eb5-48b9-8e26-e56cf4b42657', '7f672889-9d29-40fc-ae4e-676b07ed81ba'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:04 devstack sudo[86422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:04 devstack sudo[86422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:04 devstack sudo[86422]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.530s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:04 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:04 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Deleted volume successfully.
Apr 27 15:11:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8430d7a6-7134-4f10-a953-545864cf19c8 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-f954aae9-2ca8-4231-9581-340f62deca5b-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "cinder-8ee7b9dd-4fd6-40a5-82c3-34989ba97197-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-8ee7b9dd-4fd6-40a5-82c3-34989ba97197-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "cinder-quobyte-8ee7b9dd-4fd6-40a5-82c3-34989ba97197" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-quobyte-8ee7b9dd-4fd6-40a5-82c3-34989ba97197" acquired by "delete_volume" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:05 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[16530689-09b6-4017-95d3-a9cc59f74347]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:05 devstack sudo[86425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197
Apr 27 15:11:05 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:06 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197" returned: 0 in 0.830s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:06 devstack sudo[86430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197
Apr 27 15:11:06 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:06 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8ee7b9dd-4fd6-40a5-82c3-34989ba97197" returned: 0 in 0.706s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-quobyte-8ee7b9dd-4fd6-40a5-82c3-34989ba97197" released by "delete_volume" :: held 1.614s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:06 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Created reservations ['d6b936a3-5e49-4194-8055-a12036227868', '3aeb158f-0328-4068-bab3-cd68f81abed3', '50c41841-baef-49f2-80c2-ef1cce20a1f8', 'd2bbc3c1-7aff-4e90-9e5d-4a8ebf91667e'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:06 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:06 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:06 devstack sudo[86446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:06 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Flow 'volume_create_manager' (08d3a111-b200-4331-af29-f6defb21fa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc5e90c-f105-40f4-986b-0751c0541e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc5e90c-f105-40f4-986b-0751c0541e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-621188974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd095df-e7e8-49d4-8abe-f966703a32ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62592840bac94c028adc59e13622a463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:07Z,use_quota=True,user_id='10240aa71bf844acb4602588a79fe0ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e99c76-93fd-4da8-9575-efc7ce42aea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e99c76-93fd-4da8-9575-efc7ce42aea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26d5dda-2171-4023-b089-08289d710520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.image.glance [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Creating Keystone auth plugin from conf {{(pid=81538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "cinder-5e1a8b22-bcd7-42c7-9a9c-fc195760302f-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-5e1a8b22-bcd7-42c7-9a9c-fc195760302f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "cinder-quobyte-5e1a8b22-bcd7-42c7-9a9c-fc195760302f" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-quobyte-5e1a8b22-bcd7-42c7-9a9c-fc195760302f" acquired by "delete_volume" :: waited 0.043s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ac5d76-f351-49ac-9e4d-b8db8dfba05c]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:07 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.907s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:07 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Deleted volume successfully.
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c0c29de6-1fc8-423d-82b2-447243eb9947 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-8ee7b9dd-4fd6-40a5-82c3-34989ba97197-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:07 devstack sudo[86451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f
Apr 27 15:11:07 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26d5dda-2171-4023-b089-08289d710520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7dd095df-e7e8-49d4-8abe-f966703a32ec', 'volume_name': 'volume-7dd095df-e7e8-49d4-8abe-f966703a32ec', 'volume_size': 1, 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8b5f6f0ff7c46c9826225de4a824e37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17408032-d085-42b0-a4db-fa0192e428de', 'created_at': datetime.datetime(2026, 4, 27, 13, 1, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 13, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17408032-d085-42b0-a4db-fa0192e428de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f59e4d1a260>}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f923b38-cd61-4ede-ba1a-c813ee7f72e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f923b38-cd61-4ede-ba1a-c813ee7f72e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e15c47-96fd-4bff-919a-edf81890a886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:08 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Volume 7dd095df-e7e8-49d4-8abe-f966703a32ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7dd095df-e7e8-49d4-8abe-f966703a32ec', 'volume_size': 1, 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8b5f6f0ff7c46c9826225de4a824e37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17408032-d085-42b0-a4db-fa0192e428de', 'created_at': datetime.datetime(2026, 4, 27, 13, 1, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 13, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17408032-d085-42b0-a4db-fa0192e428de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f59e4d1a260>}
Apr 27 15:11:08 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Trying to clone 7dd095df-e7e8-49d4-8abe-f966703a32ec from image 17408032-d085-42b0-a4db-fa0192e428de at location (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]). {{(pid=81538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 27 15:11:08 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xnxuhpccdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81538) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 27 15:11:08 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Image download 20.69 MB at 20.69 MB/s
Apr 27 15:11:08 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[521e3550-d12c-4e24-9fe6-57168902ce3b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xnxuhpccdevstack@QuobyteHD {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:08 devstack sudo[86456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xnxuhpccdevstack@QuobyteHD
Apr 27 15:11:08 devstack sudo[86456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:08 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f" returned: 0 in 0.976s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:08 devstack sudo[86461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f
Apr 27 15:11:08 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:09 devstack sudo[86456]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xnxuhpccdevstack@QuobyteHD" returned: 0 in 0.626s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Temporary image 17408032-d085-42b0-a4db-fa0192e428de is fetched for user 10240aa71bf844acb4602588a79fe0ba. {{(pid=81538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5da3754-d037-4f4e-a107-55228babf539]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xnxuhpccdevstack@QuobyteHD {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:09 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5e1a8b22-bcd7-42c7-9a9c-fc195760302f" returned: 0 in 0.509s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-quobyte-5e1a8b22-bcd7-42c7-9a9c-fc195760302f" released by "delete_volume" :: held 1.560s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:09 devstack sudo[86467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xnxuhpccdevstack@QuobyteHD
Apr 27 15:11:09 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Created reservations ['ed2d4625-fdc3-44c6-a697-193ec8e03c89', 'b806e7c6-c326-45fe-b198-5e72a9d6047e', 'ee7779e8-710e-490d-a877-450ea969e015', '7a30524c-707c-4fd3-9ff8-5ccac290d23c'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:09 devstack sudo[86469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:09 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:09 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xnxuhpccdevstack@QuobyteHD" returned: 0 in 0.814s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-621188974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd095df-e7e8-49d4-8abe-f966703a32ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62592840bac94c028adc59e13622a463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:07Z,use_quota=True,user_id='10240aa71bf844acb4602588a79fe0ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Creating volume 7dd095df-e7e8-49d4-8abe-f966703a32ec {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:11:09 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:09 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.637s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:09 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Deleted volume successfully.
Apr 27 15:11:09 devstack sudo[86475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec 1073741824
Apr 27 15:11:09 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:09 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1ed6754b-921a-45c0-8e80-5adc9c9922c7 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-5e1a8b22-bcd7-42c7-9a9c-fc195760302f-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "cinder-3f9431e2-adaa-4901-a3df-f0022f4bf51f-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-3f9431e2-adaa-4901-a3df-f0022f4bf51f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "cinder-quobyte-3f9431e2-adaa-4901-a3df-f0022f4bf51f" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-quobyte-3f9431e2-adaa-4901-a3df-f0022f4bf51f" acquired by "delete_volume" :: waited 0.032s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:10 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e3d552-af60-4e4c-8ecd-88535244ec83]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:10 devstack sudo[86477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f
Apr 27 15:11:10 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:10 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec 1073741824" returned: 0 in 0.854s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:10 devstack sudo[86482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec
Apr 27 15:11:10 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:11 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f" returned: 0 in 0.747s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:11 devstack sudo[86487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f
Apr 27 15:11:11 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:11 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec" returned: 0 in 0.531s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG cinder.volume.volume_utils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Attempting download of 17408032-d085-42b0-a4db-fa0192e428de ((None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}])) to volume 7dd095df-e7e8-49d4-8abe-f966703a32ec. {{(pid=81538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7c4096-de6e-4409-ab78-b42329f4f9d0]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_188h17up {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:11 devstack sudo[86490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_188h17up
Apr 27 15:11:11 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:11 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3f9431e2-adaa-4901-a3df-f0022f4bf51f" returned: 0 in 0.543s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-quobyte-3f9431e2-adaa-4901-a3df-f0022f4bf51f" released by "delete_volume" :: held 1.345s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Created reservations ['6adab7da-081f-423b-90e5-d8841be0f6c1', '0ec9d009-1c9b-4e30-ad7f-8290b2a521f8', '03b0c239-523c-4da5-9866-6f58bdbc074d', '766b365c-b6a9-4965-881a-744e3304ca42'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:11 devstack sudo[86497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:11 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:12 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_188h17up" returned: 0 in 0.649s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_188h17up {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:12 devstack sudo[86501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_188h17up
Apr 27 15:11:12 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:12 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.833s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:12 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:12 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Deleted volume successfully.
Apr 27 15:11:12 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-dfc804d3-0495-49c1-9ed9-54c88042b0e7 tempest-CreateVolumesFromImageTest-1255347 None] Lock "cinder-3f9431e2-adaa-4901-a3df-f0022f4bf51f-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:12 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_188h17up" returned: 1 in 0.647s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_188h17up' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:11:12 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7ba848-ee73-4265-9a57-bfe6c0a92236]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xnxuhpccdevstack@QuobyteHD {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:12 devstack sudo[86506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xnxuhpccdevstack@QuobyteHD
Apr 27 15:11:12 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:13 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xnxuhpccdevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:13 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] 17408032-d085-42b0-a4db-fa0192e428de was qcow2, converting to raw {{(pid=81538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 27 15:11:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xnxuhpccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:13 devstack sudo[86516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xnxuhpccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec
Apr 27 15:11:13 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:15 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xnxuhpccdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec" returned: 0 in 1.929s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:15 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xnxuhpccdevstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:11:15 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Converted 112.00 MB image at 57.95 MB/s
Apr 27 15:11:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:15 devstack sudo[86569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec 1G
Apr 27 15:11:15 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Flow 'volume_create_manager' (7d6e393a-9ca2-41da-8ec1-8ae780232115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5372083-1547-48fd-95e0-99e1c615a361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5372083-1547-48fd-95e0-99e1c615a361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1666041757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595fad84-5cd3-4ec0-b0c2-ba60a5946761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09651ee859294262a07b0cd8c630760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:17Z,use_quota=True,user_id='66a02bcf473641469a608915f59103d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf52568-6826-46c0-9904-425819c05588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf52568-6826-46c0-9904-425819c05588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ff655d-e003-4663-ba4a-7b856e941d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ff655d-e003-4663-ba4a-7b856e941d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '595fad84-5cd3-4ec0-b0c2-ba60a5946761', 'volume_name': 'volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26e1201-6954-408b-a95b-976c7b38150b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e26e1201-6954-408b-a95b-976c7b38150b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dd75d4-9622-4249-8a65-660114c180e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:16 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume 595fad84-5cd3-4ec0-b0c2-ba60a5946761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761', 'volume_size': 1}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1666041757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595fad84-5cd3-4ec0-b0c2-ba60a5946761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09651ee859294262a07b0cd8c630760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:17Z,use_quota=True,user_id='66a02bcf473641469a608915f59103d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Creating volume 595fad84-5cd3-4ec0-b0c2-ba60a5946761 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:11:16 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:16 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec 1G" returned: 0 in 1.285s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:16 devstack sudo[86580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761 1073741824
Apr 27 15:11:16 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f937fa7-0556-4edd-8fd8-f8d4bc0f0fb3]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:16 devstack sudo[86582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec
Apr 27 15:11:16 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:17 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec" returned: 0 in 0.861s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:17 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761 1073741824" returned: 0 in 0.988s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:17 devstack sudo[86590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec
Apr 27 15:11:17 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:17 devstack sudo[86592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761
Apr 27 15:11:17 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:18 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec" returned: 1 in 0.825s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.volume_utils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Downloaded image 17408032-d085-42b0-a4db-fa0192e428de ((None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}])) to volume 7dd095df-e7e8-49d4-8abe-f966703a32ec successfully. {{(pid=81538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Temporary image 17408032-d085-42b0-a4db-fa0192e428de for user 10240aa71bf844acb4602588a79fe0ba is deleted. {{(pid=81538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 27 15:11:18 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.volume_utils [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Marking volume 7dd095df-e7e8-49d4-8abe-f966703a32ec as bootable. {{(pid=81538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761" returned: 0 in 0.768s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Copying metadata from image 17408032-d085-42b0-a4db-fa0192e428de to 7dd095df-e7e8-49d4-8abe-f966703a32ec. {{(pid=81538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Creating volume glance metadata for volume 7dd095df-e7e8-49d4-8abe-f966703a32ec backed by image 17408032-d085-42b0-a4db-fa0192e428de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dd75d4-9622-4249-8a65-660114c180e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c482a3a7-f684-40c0-ad60-dcf35eb3f1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:18 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761 (595fad84-5cd3-4ec0-b0c2-ba60a5946761): created successfully
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c482a3a7-f684-40c0-ad60-dcf35eb3f1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Flow 'volume_create_manager' (7d6e393a-9ca2-41da-8ec1-8ae780232115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:18 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ee576c6f-2a3b-4093-b158-1d9d99577b15 tempest-CreateVolumesFromSnapshotTest-772180983 None] Created volume successfully.
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Flow 'volume_create_manager' (9b2d91d7-98cf-41f3-a4e1-feb96a6d59cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75539448-92fb-45ce-839d-0dc9ef741514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75539448-92fb-45ce-839d-0dc9ef741514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1593507745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d8a778-2805-4986-8118-8e4e58b12233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c7dd7060ad4c4291961df432d0e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:19Z,use_quota=True,user_id='8389dea4739b40c8979ae47cf6deaf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b05f31-593b-4602-8b0f-b9891ca81836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b05f31-593b-4602-8b0f-b9891ca81836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b993f11-df5a-479a-85b3-8611fd6366eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b993f11-df5a-479a-85b3-8611fd6366eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60d8a778-2805-4986-8118-8e4e58b12233', 'volume_name': 'volume-60d8a778-2805-4986-8118-8e4e58b12233', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a569378-121d-40a9-8072-50f5cd5cdba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a569378-121d-40a9-8072-50f5cd5cdba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b6c745-57e8-42ce-a4e3-7eafafc8f8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:18 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Volume 60d8a778-2805-4986-8118-8e4e58b12233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60d8a778-2805-4986-8118-8e4e58b12233', 'volume_size': 1}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1593507745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d8a778-2805-4986-8118-8e4e58b12233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c7dd7060ad4c4291961df432d0e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:19Z,use_quota=True,user_id='8389dea4739b40c8979ae47cf6deaf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Creating volume 60d8a778-2805-4986-8118-8e4e58b12233 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:11:18 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-60d8a778-2805-4986-8118-8e4e58b12233 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e15c47-96fd-4bff-919a-edf81890a886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd095df-e7e8-49d4-8abe-f966703a32ec', 'volume_size': 1, 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8b5f6f0ff7c46c9826225de4a824e37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17408032-d085-42b0-a4db-fa0192e428de', 'created_at': datetime.datetime(2026, 4, 27, 13, 1, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 13, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17408032-d085-42b0-a4db-fa0192e428de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f59e4d1a260>}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b3f2e0-17cc-41f4-9ee8-a1d6ee28ac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:18 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Volume volume-7dd095df-e7e8-49d4-8abe-f966703a32ec (7dd095df-e7e8-49d4-8abe-f966703a32ec): created successfully
Apr 27 15:11:18 devstack sudo[86599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-60d8a778-2805-4986-8118-8e4e58b12233 1073741824
Apr 27 15:11:18 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b3f2e0-17cc-41f4-9ee8-a1d6ee28ac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Flow 'volume_create_manager' (08d3a111-b200-4331-af29-f6defb21fa8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:18 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-a8a05f17-d4e3-44c6-9f18-a6850437ef3d tempest-VolumesImageMetadata-240954425 None] Created volume successfully.
Apr 27 15:11:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:19 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-60d8a778-2805-4986-8118-8e4e58b12233 1073741824" returned: 0 in 0.804s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-60d8a778-2805-4986-8118-8e4e58b12233 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:19 devstack sudo[86604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-60d8a778-2805-4986-8118-8e4e58b12233
Apr 27 15:11:19 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Acquiring lock "cinder-7dd095df-e7e8-49d4-8abe-f966703a32ec-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Lock "cinder-7dd095df-e7e8-49d4-8abe-f966703a32ec-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Acquiring lock "cinder-quobyte-7dd095df-e7e8-49d4-8abe-f966703a32ec" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Lock "cinder-quobyte-7dd095df-e7e8-49d4-8abe-f966703a32ec" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:19 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b701d0fa-d149-4e39-bb57-50582834660c]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:20 devstack sudo[86606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec
Apr 27 15:11:20 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:20 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-60d8a778-2805-4986-8118-8e4e58b12233" returned: 0 in 0.529s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.262s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b6c745-57e8-42ce-a4e3-7eafafc8f8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d8a778-2805-4986-8118-8e4e58b12233', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2964433-0529-4f9e-a309-71d38b5ed261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] Creating offline snapshot 2a65e454-6f31-4bb8-aa06-f7f589ce44bd of volume 595fad84-5cd3-4ec0-b0c2-ba60a5946761 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:11:20 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Volume volume-60d8a778-2805-4986-8118-8e4e58b12233 (60d8a778-2805-4986-8118-8e4e58b12233): created successfully
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2964433-0529-4f9e-a309-71d38b5ed261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Flow 'volume_create_manager' (9b2d91d7-98cf-41f3-a4e1-feb96a6d59cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[61855c78-6aeb-43cb-abef-6706af724b79]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:20 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ca938cad-9922-407e-881f-d48385322578 tempest-VolumesActionsTest-2057272370 None] Created volume successfully.
Apr 27 15:11:20 devstack sudo[86609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761
Apr 27 15:11:20 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:20 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec" returned: 0 in 0.769s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-65d51c29-d0f8-4952-8f68-46df9e613675 tempest-VolumesActionsTest-2057272370 None] Acquiring lock "cinder-60d8a778-2805-4986-8118-8e4e58b12233" by "attach_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-65d51c29-d0f8-4952-8f68-46df9e613675 tempest-VolumesActionsTest-2057272370 None] Lock "cinder-60d8a778-2805-4986-8118-8e4e58b12233" acquired by "attach_volume" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:20 devstack sudo[86613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec
Apr 27 15:11:20 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:20 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-65d51c29-d0f8-4952-8f68-46df9e613675 tempest-VolumesActionsTest-2057272370 None] Attaching volume 60d8a778-2805-4986-8118-8e4e58b12233 to instance cd2f766c-aecc-4ac5-9dca-61975a0ff640 at mountpoint /dev/vdb on host None.
Apr 27 15:11:20 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761" returned: 0 in 0.644s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:20 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-65d51c29-d0f8-4952-8f68-46df9e613675 tempest-VolumesActionsTest-2057272370 None] Attach volume completed successfully.
Apr 27 15:11:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-65d51c29-d0f8-4952-8f68-46df9e613675 tempest-VolumesActionsTest-2057272370 None] Lock "cinder-60d8a778-2805-4986-8118-8e4e58b12233" released by "attach_volume" :: held 0.150s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:20 devstack sudo[86618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd 1G
Apr 27 15:11:20 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:21 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec" returned: 1 in 0.690s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:11:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:21 devstack sudo[86626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec
Apr 27 15:11:21 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:21 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd 1G" returned: 0 in 0.940s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:21 devstack sudo[86628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd
Apr 27 15:11:21 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:22 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:22 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-d4a68eba-4d51-4918-a75d-44cddb8317a8 tempest-VolumesActionsTest-1493496986 None] Terminate volume connection completed successfully.
Apr 27 15:11:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7dd095df-e7e8-49d4-8abe-f966703a32ec" returned: 0 in 0.814s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Lock "cinder-quobyte-7dd095df-e7e8-49d4-8abe-f966703a32ec" released by "delete_volume" :: held 2.338s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:22 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Created reservations ['bb134a8f-6291-40ef-8d96-5c9ebb55f6c4', '016dcc67-db62-4868-9679-48f49cb28070', 'f0728919-b28d-471f-ac9f-4193c8203aff', 'bc9d0424-550c-4973-b645-8171f39230bd'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:22 devstack sudo[86631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:22 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:22 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd" returned: 0 in 0.740s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:22 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd is being set with open permissions: ugo+rw
Apr 27 15:11:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:22 devstack sudo[86636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd
Apr 27 15:11:22 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d4a68eba-4d51-4918-a75d-44cddb8317a8 tempest-VolumesActionsTest-1493496986 None] Acquiring lock "cinder-60d8a778-2805-4986-8118-8e4e58b12233-detach_volume" by "detach_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d4a68eba-4d51-4918-a75d-44cddb8317a8 tempest-VolumesActionsTest-1493496986 None] Lock "cinder-60d8a778-2805-4986-8118-8e4e58b12233-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:22 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-d4a68eba-4d51-4918-a75d-44cddb8317a8 tempest-VolumesActionsTest-1493496986 None] Detaching volume 60d8a778-2805-4986-8118-8e4e58b12233 from instance cd2f766c-aecc-4ac5-9dca-61975a0ff640.
Apr 27 15:11:22 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-d4a68eba-4d51-4918-a75d-44cddb8317a8 tempest-VolumesActionsTest-1493496986 None] Detach volume completed successfully.
Apr 27 15:11:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d4a68eba-4d51-4918-a75d-44cddb8317a8 tempest-VolumesActionsTest-1493496986 None] Lock "cinder-60d8a778-2805-4986-8118-8e4e58b12233-detach_volume" released by "detach_volume" :: held 0.125s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:23 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd" returned: 0 in 0.574s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:23 devstack sudo[86641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.info
Apr 27 15:11:23 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:23 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 1.287s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:23 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:23 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Deleted volume successfully.
Apr 27 15:11:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b119ace3-e36a-4c67-abd8-2a8e9908fae6 tempest-VolumesImageMetadata-240954425 None] Lock "cinder-7dd095df-e7e8-49d4-8abe-f966703a32ec-delete_volume" released by "delete_volume" :: held 3.862s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ea725eb9-8c55-4555-a5d8-5b3d875d364f tempest-VolumesActionsTest-2057272370 None] Acquiring lock "cinder-60d8a778-2805-4986-8118-8e4e58b12233-detach_volume" by "detach_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ea725eb9-8c55-4555-a5d8-5b3d875d364f tempest-VolumesActionsTest-2057272370 None] Lock "cinder-60d8a778-2805-4986-8118-8e4e58b12233-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:23 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ea725eb9-8c55-4555-a5d8-5b3d875d364f tempest-VolumesActionsTest-2057272370 None] Volume detach called, but volume not attached.
Apr 27 15:11:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ea725eb9-8c55-4555-a5d8-5b3d875d364f tempest-VolumesActionsTest-2057272370 None] Lock "cinder-60d8a778-2805-4986-8118-8e4e58b12233-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:24 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.info" returned: 0 in 1.242s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:24 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.info is being set with open permissions: ugo+rw
Apr 27 15:11:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:24 devstack sudo[86658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.info
Apr 27 15:11:24 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Acquiring lock "cinder-60d8a778-2805-4986-8118-8e4e58b12233-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Lock "cinder-60d8a778-2805-4986-8118-8e4e58b12233-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Acquiring lock "cinder-quobyte-60d8a778-2805-4986-8118-8e4e58b12233" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Lock "cinder-quobyte-60d8a778-2805-4986-8118-8e4e58b12233" acquired by "delete_volume" :: waited 0.016s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:24 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c557f7bd-c498-4364-85d7-88c10e097aef]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-60d8a778-2805-4986-8118-8e4e58b12233 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:24 devstack sudo[86660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-60d8a778-2805-4986-8118-8e4e58b12233
Apr 27 15:11:24 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:25 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.info" returned: 0 in 1.049s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.329s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:25 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-a6ff6c87-a625-4f97-9db5-b40b9f95d773 tempest-CreateVolumesFromSnapshotTest-772180983 None] Create snapshot completed successfully
Apr 27 15:11:25 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-60d8a778-2805-4986-8118-8e4e58b12233" returned: 0 in 1.113s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-60d8a778-2805-4986-8118-8e4e58b12233 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:25 devstack sudo[86667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-60d8a778-2805-4986-8118-8e4e58b12233
Apr 27 15:11:25 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:26 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-60d8a778-2805-4986-8118-8e4e58b12233" returned: 0 in 0.530s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Lock "cinder-quobyte-60d8a778-2805-4986-8118-8e4e58b12233" released by "delete_volume" :: held 1.698s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:26 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Created reservations ['61553f82-6b61-4682-a87a-8d4772a0d0a9', 'aef99489-a298-4859-8550-6723d9c19882', '85a4633d-8772-4d09-81fe-87d590ed9df2', '48eb712d-3eaa-4861-8c38-a300abb81232'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:26 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:26 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:26 devstack sudo[86670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:26 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:27 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.588s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:27 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Deleted volume successfully.
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-277c8721-9f31-4592-946c-8a4158fb1e8c tempest-VolumesActionsTest-2057272370 None] Lock "cinder-60d8a778-2805-4986-8118-8e4e58b12233-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Flow 'volume_create_manager' (b6709728-1b11-42fa-b451-58ea81b8277b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529a05d1-99cd-494a-93d9-a8d8ceb57b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529a05d1-99cd-494a-93d9-a8d8ceb57b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-644908769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73e2c0c-c141-4279-ba9f-61070f0556df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad4c18122b6a41c6bc7419fa2eaaf158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:27Z,use_quota=True,user_id='db7399a4b1f240399bd1a5a72f6ccd94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33212b4-549a-4970-8a95-e434c8591df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33212b4-549a-4970-8a95-e434c8591df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa048fe7-7dab-44f2-8dc9-9b3896cbc3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa048fe7-7dab-44f2-8dc9-9b3896cbc3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73e2c0c-c141-4279-ba9f-61070f0556df', 'volume_name': 'volume-e73e2c0c-c141-4279-ba9f-61070f0556df', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd263f1-743f-4ad0-8e44-d3fb8180fd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd263f1-743f-4ad0-8e44-d3fb8180fd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473e057c-ffaf-4335-91ad-c9c7f6a97005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:27 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Volume e73e2c0c-c141-4279-ba9f-61070f0556df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73e2c0c-c141-4279-ba9f-61070f0556df', 'volume_size': 1}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-644908769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73e2c0c-c141-4279-ba9f-61070f0556df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad4c18122b6a41c6bc7419fa2eaaf158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:27Z,use_quota=True,user_id='db7399a4b1f240399bd1a5a72f6ccd94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Creating volume e73e2c0c-c141-4279-ba9f-61070f0556df {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:11:27 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:27 devstack sudo[86681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df 1073741824
Apr 27 15:11:27 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Flow 'volume_create_manager' (8e4a51d6-f0e5-4c2e-a0a7-02f83788a4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276d94dd-d603-4888-b01c-017456f88f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276d94dd-d603-4888-b01c-017456f88f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-312835492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de88ae9d-6230-4f6d-93b0-5e7e4168f0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09651ee859294262a07b0cd8c630760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:28Z,use_quota=True,user_id='66a02bcf473641469a608915f59103d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24910d5-b318-4cd4-8df0-a55dc94d35a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24910d5-b318-4cd4-8df0-a55dc94d35a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (890097e0-9fff-40d0-ae21-d3c1d7a5db65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (890097e0-9fff-40d0-ae21-d3c1d7a5db65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de88ae9d-6230-4f6d-93b0-5e7e4168f0fb', 'volume_name': 'volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae10c0c6-79d4-4846-a4e3-425585f57fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae10c0c6-79d4-4846-a4e3-425585f57fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7b2b07-a3b8-4525-9065-646d551bf500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:27 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume de88ae9d-6230-4f6d-93b0-5e7e4168f0fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb', 'volume_size': 1}
Apr 27 15:11:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Flow 'volume_create_manager' (832d76ed-0b03-47d3-8001-911af2ae1c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b192e887-5776-4ad3-bff8-52ce56863179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b192e887-5776-4ad3-bff8-52ce56863179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-886911203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5208d2f-80fd-4137-8ded-8085317a147a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09651ee859294262a07b0cd8c630760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:28Z,use_quota=True,user_id='66a02bcf473641469a608915f59103d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256c6454-dae8-4c4d-99c0-0be0431c331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256c6454-dae8-4c4d-99c0-0be0431c331b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4818962-84af-4709-b18c-9cf14cd5881c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4818962-84af-4709-b18c-9cf14cd5881c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5208d2f-80fd-4137-8ded-8085317a147a', 'volume_name': 'volume-d5208d2f-80fd-4137-8ded-8085317a147a', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed07a8e-e57b-47c3-8aed-46ff2d76e5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed07a8e-e57b-47c3-8aed-46ff2d76e5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6281ca-5704-4c3c-90e2-eea8f4bcf964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:28 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume d5208d2f-80fd-4137-8ded-8085317a147a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5208d2f-80fd-4137-8ded-8085317a147a', 'volume_size': 1}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Flow 'volume_create_manager' (ccafba88-320a-4caf-bc30-69bee975acc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7f0f15-83b7-40ee-bfbc-3a8621b1b669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7f0f15-83b7-40ee-bfbc-3a8621b1b669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1308952138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e323e3bd-fc40-4a2c-8814-3ec5d9cd0022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09651ee859294262a07b0cd8c630760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:29Z,use_quota=True,user_id='66a02bcf473641469a608915f59103d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1678dff-4071-4d7d-818b-935a5f6e123c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1678dff-4071-4d7d-818b-935a5f6e123c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eefeccc-9402-4913-9652-4ec6e775bee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eefeccc-9402-4913-9652-4ec6e775bee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e323e3bd-fc40-4a2c-8814-3ec5d9cd0022', 'volume_name': 'volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed18c5f-48f4-4697-9ac7-7e9bf8605ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed18c5f-48f4-4697-9ac7-7e9bf8605ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138d0325-2b40-49c0-b772-294b44db592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:28 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume e323e3bd-fc40-4a2c-8814-3ec5d9cd0022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022', 'volume_size': 1}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:28 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df 1073741824" returned: 0 in 1.158s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:28 devstack sudo[86708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df
Apr 27 15:11:28 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:11:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Flow 'volume_create_manager' (21ad743f-7f99-42ca-b3dc-b29e3b7d1ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766e5ddf-6cb9-4a50-ae1d-476a10bd0e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766e5ddf-6cb9-4a50-ae1d-476a10bd0e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1411901965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c889d54a-f69a-461c-b74c-2220ef0a1928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09651ee859294262a07b0cd8c630760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:29Z,use_quota=True,user_id='66a02bcf473641469a608915f59103d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f01b52c-c0a0-4c3a-b9cc-f4469f5b3c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f01b52c-c0a0-4c3a-b9cc-f4469f5b3c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64917be-f3cf-4f36-afdf-112b14595503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64917be-f3cf-4f36-afdf-112b14595503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c889d54a-f69a-461c-b74c-2220ef0a1928', 'volume_name': 'volume-c889d54a-f69a-461c-b74c-2220ef0a1928', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941931ed-34c6-4e2c-8df8-f3f2ab30bc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941931ed-34c6-4e2c-8df8-f3f2ab30bc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d06173-15ea-4944-93e7-f667dbd3c50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:29 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume c889d54a-f69a-461c-b74c-2220ef0a1928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c889d54a-f69a-461c-b74c-2220ef0a1928', 'volume_size': 1}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Flow 'volume_create_manager' (ff5317f7-2617-45c7-a24d-b4d5e4114233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2e6d2c-cf59-49b1-ac8d-75034730eb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2e6d2c-cf59-49b1-ac8d-75034730eb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-627312108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09651ee859294262a07b0cd8c630760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:29Z,use_quota=True,user_id='66a02bcf473641469a608915f59103d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec9aee9-9591-490d-8454-f931d6f105d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec9aee9-9591-490d-8454-f931d6f105d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1c5b83-9fe3-497a-a0df-a06db3a61b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1c5b83-9fe3-497a-a0df-a06db3a61b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a', 'volume_name': 'volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e488443-17a7-46ee-8060-56d60d038ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e488443-17a7-46ee-8060-56d60d038ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3e8796-fa33-43c2-b293-867e9beabb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:29 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a', 'volume_size': 1}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:29 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df" returned: 0 in 0.864s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.089s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.868s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-312835492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de88ae9d-6230-4f6d-93b0-5e7e4168f0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09651ee859294262a07b0cd8c630760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:28Z,use_quota=True,user_id='66a02bcf473641469a608915f59103d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Creating volume de88ae9d-6230-4f6d-93b0-5e7e4168f0fb {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:11:29 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:29 devstack sudo[86742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb 1073741824
Apr 27 15:11:29 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473e057c-ffaf-4335-91ad-c9c7f6a97005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73e2c0c-c141-4279-ba9f-61070f0556df', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d22f8ac-b461-4c86-a8ed-caaa74c5ea20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:29 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Volume volume-e73e2c0c-c141-4279-ba9f-61070f0556df (e73e2c0c-c141-4279-ba9f-61070f0556df): created successfully
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d22f8ac-b461-4c86-a8ed-caaa74c5ea20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Flow 'volume_create_manager' (b6709728-1b11-42fa-b451-58ea81b8277b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:29 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-c36f4b5a-8ff2-4e9b-865b-204990a1929a tempest-SnapshotMetadataTestJSON-770519212 None] Created volume successfully.
Apr 27 15:11:30 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb 1073741824" returned: 0 in 0.632s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:30 devstack sudo[86748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb
Apr 27 15:11:30 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:31 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb" returned: 0 in 0.563s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.853s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-886911203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5208d2f-80fd-4137-8ded-8085317a147a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09651ee859294262a07b0cd8c630760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:28Z,use_quota=True,user_id='66a02bcf473641469a608915f59103d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Creating volume d5208d2f-80fd-4137-8ded-8085317a147a {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:11:31 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d5208d2f-80fd-4137-8ded-8085317a147a 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:31 devstack sudo[86755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d5208d2f-80fd-4137-8ded-8085317a147a 1073741824
Apr 27 15:11:31 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7b2b07-a3b8-4525-9065-646d551bf500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a295ff59-7c2a-42b4-87f5-88db4de0be68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:31 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb (de88ae9d-6230-4f6d-93b0-5e7e4168f0fb): created successfully
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a295ff59-7c2a-42b4-87f5-88db4de0be68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Flow 'volume_create_manager' (8e4a51d6-f0e5-4c2e-a0a7-02f83788a4c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:31 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ecebb531-726c-4a8e-a676-be0f01b45f3e tempest-CreateVolumesFromSnapshotTest-772180983 None] Created volume successfully.
Apr 27 15:11:31 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d5208d2f-80fd-4137-8ded-8085317a147a 1073741824" returned: 0 in 0.718s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d5208d2f-80fd-4137-8ded-8085317a147a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:31 devstack sudo[86767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d5208d2f-80fd-4137-8ded-8085317a147a
Apr 27 15:11:31 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:32 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d5208d2f-80fd-4137-8ded-8085317a147a" returned: 0 in 0.539s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.565s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1308952138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e323e3bd-fc40-4a2c-8814-3ec5d9cd0022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09651ee859294262a07b0cd8c630760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:29Z,use_quota=True,user_id='66a02bcf473641469a608915f59103d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Creating volume e323e3bd-fc40-4a2c-8814-3ec5d9cd0022 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:11:32 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6281ca-5704-4c3c-90e2-eea8f4bcf964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5208d2f-80fd-4137-8ded-8085317a147a', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1bc6d85-685e-46f5-84ef-840f716a4c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:32 devstack sudo[86787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022 1073741824
Apr 27 15:11:32 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume volume-d5208d2f-80fd-4137-8ded-8085317a147a (d5208d2f-80fd-4137-8ded-8085317a147a): created successfully
Apr 27 15:11:32 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1bc6d85-685e-46f5-84ef-840f716a4c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Flow 'volume_create_manager' (832d76ed-0b03-47d3-8001-911af2ae1c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:32 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-d281921f-1aa7-4399-b905-e04664d7b574 tempest-CreateVolumesFromSnapshotTest-772180983 None] Created volume successfully.
Apr 27 15:11:33 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022 1073741824" returned: 0 in 0.872s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:33 devstack sudo[86808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022
Apr 27 15:11:33 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:33 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022" returned: 0 in 0.521s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.717s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1411901965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c889d54a-f69a-461c-b74c-2220ef0a1928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09651ee859294262a07b0cd8c630760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:29Z,use_quota=True,user_id='66a02bcf473641469a608915f59103d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Creating volume c889d54a-f69a-461c-b74c-2220ef0a1928 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:11:33 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c889d54a-f69a-461c-b74c-2220ef0a1928 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:33 devstack sudo[86818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c889d54a-f69a-461c-b74c-2220ef0a1928 1073741824
Apr 27 15:11:33 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138d0325-2b40-49c0-b772-294b44db592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b4361f-9e63-48d4-ba28-be9b94b0776f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:33 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022 (e323e3bd-fc40-4a2c-8814-3ec5d9cd0022): created successfully
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b4361f-9e63-48d4-ba28-be9b94b0776f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:33 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Flow 'volume_create_manager' (ccafba88-320a-4caf-bc30-69bee975acc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:33 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ba477a13-6719-4ad1-a922-19b717a78a8f tempest-CreateVolumesFromSnapshotTest-772180983 None] Created volume successfully.
Apr 27 15:11:34 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c889d54a-f69a-461c-b74c-2220ef0a1928 1073741824" returned: 0 in 0.756s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c889d54a-f69a-461c-b74c-2220ef0a1928 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:34 devstack sudo[86823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c889d54a-f69a-461c-b74c-2220ef0a1928
Apr 27 15:11:34 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:34 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:11:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Flow 'volume_create_manager' (51b98bc1-123e-4efb-8495-f329143aa21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c20644d-edc9-45e4-bf27-7aa93988fab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c20644d-edc9-45e4-bf27-7aa93988fab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415097108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12a833b-3993-40d0-9461-1d7c754110ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c7dd7060ad4c4291961df432d0e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:35Z,use_quota=True,user_id='8389dea4739b40c8979ae47cf6deaf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e49887-7e9f-43fd-aaba-a18b65e59d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e49887-7e9f-43fd-aaba-a18b65e59d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413071ea-394d-48b8-81ee-698e39c75df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413071ea-394d-48b8-81ee-698e39c75df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b12a833b-3993-40d0-9461-1d7c754110ad', 'volume_name': 'volume-b12a833b-3993-40d0-9461-1d7c754110ad', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428686dc-35a2-46de-a38b-e85ae4c9e3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428686dc-35a2-46de-a38b-e85ae4c9e3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec8eb21-2788-4d8e-8509-60d17cfb70ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:34 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Volume b12a833b-3993-40d0-9461-1d7c754110ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b12a833b-3993-40d0-9461-1d7c754110ad', 'volume_size': 1}
Apr 27 15:11:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:35 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c889d54a-f69a-461c-b74c-2220ef0a1928" returned: 0 in 0.549s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.526s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-627312108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09651ee859294262a07b0cd8c630760b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:29Z,use_quota=True,user_id='66a02bcf473641469a608915f59103d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Creating volume ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:11:35 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d06173-15ea-4944-93e7-f667dbd3c50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c889d54a-f69a-461c-b74c-2220ef0a1928', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:35 devstack sudo[86826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a 1073741824
Apr 27 15:11:35 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4925dc04-872c-4c91-8500-6f6f57dbfa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:35 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume volume-c889d54a-f69a-461c-b74c-2220ef0a1928 (c889d54a-f69a-461c-b74c-2220ef0a1928): created successfully
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4925dc04-872c-4c91-8500-6f6f57dbfa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Flow 'volume_create_manager' (21ad743f-7f99-42ca-b3dc-b29e3b7d1ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:35 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5846ad48-3270-466a-8698-ca007589a12e tempest-CreateVolumesFromSnapshotTest-772180983 None] Created volume successfully.
Apr 27 15:11:35 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a 1073741824" returned: 0 in 0.789s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:36 devstack sudo[86831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a
Apr 27 15:11:36 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:36 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a" returned: 0 in 0.541s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:11:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.615s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] Creating offline snapshot bd12170e-171f-4011-8f71-0ff72158b380 of volume e73e2c0c-c141-4279-ba9f-61070f0556df {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:11:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3e8796-fa33-43c2-b293-867e9beabb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1874ba-04c2-4ff1-9bca-3977df0bf335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:36 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3868fb-a6db-492e-a112-655ac2c49f42]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:36 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Volume volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a (ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a): created successfully
Apr 27 15:11:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1874ba-04c2-4ff1-9bca-3977df0bf335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Flow 'volume_create_manager' (ff5317f7-2617-45c7-a24d-b4d5e4114233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:36 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ee4e15b5-5dae-417f-be26-ab2d0113b35d tempest-CreateVolumesFromSnapshotTest-772180983 None] Created volume successfully.
Apr 27 15:11:36 devstack sudo[86837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df
Apr 27 15:11:36 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:37 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df" returned: 0 in 0.612s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:37 devstack sudo[86843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380 1G
Apr 27 15:11:37 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:37 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:37 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:37 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-quobyte-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:37 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a" acquired by "delete_volume" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:37 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd33c87-a0d8-4f4e-ac10-c3bfe8f9ca80]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:37 devstack sudo[86845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a
Apr 27 15:11:37 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:37 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380 1G" returned: 0 in 0.740s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e73e2c0c-c141-4279-ba9f-61070f0556df -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:38 devstack sudo[86853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e73e2c0c-c141-4279-ba9f-61070f0556df -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380
Apr 27 15:11:38 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:38 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a" returned: 0 in 0.553s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:38 devstack sudo[86855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a
Apr 27 15:11:38 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:38 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e73e2c0c-c141-4279-ba9f-61070f0556df -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380" returned: 0 in 0.507s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:38 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380 is being set with open permissions: ugo+rw
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:38 devstack sudo[86861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380
Apr 27 15:11:38 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:38 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a" returned: 0 in 0.624s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a" released by "delete_volume" :: held 1.218s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Created reservations ['b668bb02-5b78-40a3-b0ae-d793b95846e7', '9e96169a-acfd-446e-9633-3de74ed82ef9', '0be083ff-2162-4a2a-943f-a58971b9994a', '3b3d63e9-f136-442d-adce-83288029e4a5'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:38 devstack sudo[86864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:38 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:39 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380" returned: 0 in 0.572s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:39 devstack sudo[86867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.info
Apr 27 15:11:39 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:39 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.556s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:39 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Deleted volume successfully.
Apr 27 15:11:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e42e3abe-aeaa-46de-ad08-bab82b7c2be1 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-ef6ab4f0-076e-4ab9-bcd8-c74a1b7abc7a-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-c889d54a-f69a-461c-b74c-2220ef0a1928-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:39 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.info" returned: 0 in 0.603s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:39 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.info is being set with open permissions: ugo+rw
Apr 27 15:11:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-c889d54a-f69a-461c-b74c-2220ef0a1928-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:39 devstack sudo[86871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.info
Apr 27 15:11:39 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-quobyte-c889d54a-f69a-461c-b74c-2220ef0a1928" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-c889d54a-f69a-461c-b74c-2220ef0a1928" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:39 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1386948-ceb1-46c9-9650-eeef825b431a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c889d54a-f69a-461c-b74c-2220ef0a1928 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:39 devstack sudo[86873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c889d54a-f69a-461c-b74c-2220ef0a1928
Apr 27 15:11:39 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:40 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.info" returned: 0 in 0.530s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.683s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.448s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415097108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12a833b-3993-40d0-9461-1d7c754110ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c7dd7060ad4c4291961df432d0e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:35Z,use_quota=True,user_id='8389dea4739b40c8979ae47cf6deaf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:11:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Creating volume b12a833b-3993-40d0-9461-1d7c754110ad {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:11:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:11:40 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:11:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b12a833b-3993-40d0-9461-1d7c754110ad 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:40 devstack sudo[86876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b12a833b-3993-40d0-9461-1d7c754110ad 1073741824
Apr 27 15:11:40 devstack sudo[86876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:40 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-18960704-c826-4487-a791-146119bb3641 tempest-SnapshotMetadataTestJSON-770519212 None] Create snapshot completed successfully
Apr 27 15:11:40 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c889d54a-f69a-461c-b74c-2220ef0a1928" returned: 0 in 0.740s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c889d54a-f69a-461c-b74c-2220ef0a1928 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:40 devstack sudo[86881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c889d54a-f69a-461c-b74c-2220ef0a1928
Apr 27 15:11:40 devstack sudo[86881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:41 devstack sudo[86876]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b12a833b-3993-40d0-9461-1d7c754110ad 1073741824" returned: 0 in 1.171s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b12a833b-3993-40d0-9461-1d7c754110ad {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:41 devstack sudo[86881]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c889d54a-f69a-461c-b74c-2220ef0a1928" returned: 0 in 0.948s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:41 devstack sudo[86887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b12a833b-3993-40d0-9461-1d7c754110ad
Apr 27 15:11:41 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-c889d54a-f69a-461c-b74c-2220ef0a1928" released by "delete_volume" :: held 1.757s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Created reservations ['0a83126c-86a6-4e32-b618-12620f9467cd', 'a80ceb85-5390-4d7c-bed0-e48e6bb25f1d', 'bee6e24e-731d-41df-91f4-8fe4b9b27418', '98f20d71-c78d-4f8b-b83a-3b96c16a3922'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Acquiring lock "cinder-bd12170e-171f-4011-8f71-0ff72158b380-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Lock "cinder-bd12170e-171f-4011-8f71-0ff72158b380-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Acquiring lock "cinder-quobyte-e73e2c0c-c141-4279-ba9f-61070f0556df" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Lock "cinder-quobyte-e73e2c0c-c141-4279-ba9f-61070f0556df" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Acquiring lock "cinder-quobyte-bd12170e-171f-4011-8f71-0ff72158b380" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Lock "cinder-quobyte-bd12170e-171f-4011-8f71-0ff72158b380" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Deleting offline snapshot bd12170e-171f-4011-8f71-0ff72158b380 of volume e73e2c0c-c141-4279-ba9f-61070f0556df {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] snapshot_file for this snap is: volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c54460-b4b6-4e5c-ae8e-06afdda75604]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:41 devstack sudo[86890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:41 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:42 devstack sudo[86889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380
Apr 27 15:11:42 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:42 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-quobyte-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b12a833b-3993-40d0-9461-1d7c754110ad" returned: 0 in 0.955s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:11:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec8eb21-2788-4d8e-8509-60d17cfb70ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b12a833b-3993-40d0-9461-1d7c754110ad', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f33c675-ce49-48c2-9ec2-cb44ea5571d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022" acquired by "delete_volume" :: waited 0.097s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:42 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Volume volume-b12a833b-3993-40d0-9461-1d7c754110ad (b12a833b-3993-40d0-9461-1d7c754110ad): created successfully
Apr 27 15:11:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f33c675-ce49-48c2-9ec2-cb44ea5571d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Flow 'volume_create_manager' (51b98bc1-123e-4efb-8495-f329143aa21d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:42 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5f9ac7-8402-456d-be36-1b842937b85e]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:42 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-4b1ace2f-7bbe-429e-99ee-1eb6410823f9 tempest-VolumesActionsTest-2057272370 None] Created volume successfully.
Apr 27 15:11:42 devstack sudo[86894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022
Apr 27 15:11:42 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:43 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 1.191s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:43 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Deleted volume successfully.
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c7b85312-d86a-4a2f-b1a7-23f6c5cfedbc tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-c889d54a-f69a-461c-b74c-2220ef0a1928-delete_volume" released by "delete_volume" :: held 3.367s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:43 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380" returned: 0 in 1.715s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e73e2c0c-c141-4279-ba9f-61070f0556df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:11:43 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022" returned: 0 in 1.002s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8650c43f-878b-48e3-85c0-1f1ee029a261]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:43 devstack sudo[86918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022
Apr 27 15:11:43 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Acquiring lock "cinder-b12a833b-3993-40d0-9461-1d7c754110ad-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Lock "cinder-b12a833b-3993-40d0-9461-1d7c754110ad-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Acquiring lock "cinder-quobyte-b12a833b-3993-40d0-9461-1d7c754110ad" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:43 devstack sudo[86919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df
Apr 27 15:11:43 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Lock "cinder-quobyte-b12a833b-3993-40d0-9461-1d7c754110ad" acquired by "delete_volume" :: waited 0.029s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ba27d0-7afa-4b09-9043-1c2ac1f4f46e]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b12a833b-3993-40d0-9461-1d7c754110ad {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:44 devstack sudo[86922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b12a833b-3993-40d0-9461-1d7c754110ad
Apr 27 15:11:44 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:44 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022" returned: 0 in 0.966s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022" released by "delete_volume" :: held 2.044s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:44 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Created reservations ['e25fba0d-f674-491d-b150-833022aa7395', '47445343-88b8-4317-895d-ed5c6f6a6f0b', '5388e8c1-9dde-404d-abb6-bcd0053be973', '5bc8699c-7112-4a8a-8fd6-a5389aa987d3'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:44 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:44 devstack sudo[86932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:44 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df" returned: 0 in 1.192s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:44 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b12a833b-3993-40d0-9461-1d7c754110ad" returned: 0 in 0.934s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b12a833b-3993-40d0-9461-1d7c754110ad {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:44 devstack sudo[86934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380
Apr 27 15:11:44 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:44 devstack sudo[86935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b12a833b-3993-40d0-9461-1d7c754110ad
Apr 27 15:11:44 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:45 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.714s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:45 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Deleted volume successfully.
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5712751c-d116-438d-b90c-225b589477cd tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-e323e3bd-fc40-4a2c-8814-3ec5d9cd0022-delete_volume" released by "delete_volume" :: held 3.296s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:45 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b12a833b-3993-40d0-9461-1d7c754110ad" returned: 0 in 0.730s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Lock "cinder-quobyte-b12a833b-3993-40d0-9461-1d7c754110ad" released by "delete_volume" :: held 1.718s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Created reservations ['4d9942fe-f457-49bf-83d5-e64c5d237328', '520377c0-5955-4134-921c-921f8da5d38a', 'a3e0af24-767c-44da-966e-e6366b989dab', 'f85c3f59-7f4e-493b-b8fb-48ee84302252'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-d5208d2f-80fd-4137-8ded-8085317a147a-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-d5208d2f-80fd-4137-8ded-8085317a147a-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-quobyte-d5208d2f-80fd-4137-8ded-8085317a147a" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:45 devstack sudo[86967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:45 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-d5208d2f-80fd-4137-8ded-8085317a147a" acquired by "delete_volume" :: waited 0.016s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:45 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380" returned: 0 in 1.069s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3492188d-2674-4e43-9f06-c72234bdc336]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d5208d2f-80fd-4137-8ded-8085317a147a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:45 devstack sudo[86969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380
Apr 27 15:11:45 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:46 devstack sudo[86970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d5208d2f-80fd-4137-8ded-8085317a147a
Apr 27 15:11:46 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:46 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.634s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:46 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Deleted volume successfully.
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ccaac74c-32ff-4947-835b-525464516ed1 tempest-VolumesActionsTest-1493496986 None] Lock "cinder-b12a833b-3993-40d0-9461-1d7c754110ad-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Flow 'volume_create_manager' (2486336c-6fb0-4754-af1a-61885fd5308d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcdab6f-e499-472b-bdd8-ddaa7c6af449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcdab6f-e499-472b-bdd8-ddaa7c6af449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1979817726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b389833b-08e2-4095-b301-8aa906c15462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c7dd7060ad4c4291961df432d0e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:46Z,use_quota=True,user_id='8389dea4739b40c8979ae47cf6deaf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408fdb3c-da9f-41dd-bce0-29ea2c7ee99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408fdb3c-da9f-41dd-bce0-29ea2c7ee99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de387867-6cce-49eb-977d-be55e17ab604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de387867-6cce-49eb-977d-be55e17ab604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b389833b-08e2-4095-b301-8aa906c15462', 'volume_name': 'volume-b389833b-08e2-4095-b301-8aa906c15462', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8906387f-01f7-4de8-9f33-6ff6b70f9abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8906387f-01f7-4de8-9f33-6ff6b70f9abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19cc890-9895-4f2c-ae6e-b362850cd775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:46 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Volume b389833b-08e2-4095-b301-8aa906c15462: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b389833b-08e2-4095-b301-8aa906c15462', 'volume_size': 1}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1979817726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b389833b-08e2-4095-b301-8aa906c15462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c7dd7060ad4c4291961df432d0e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:46Z,use_quota=True,user_id='8389dea4739b40c8979ae47cf6deaf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Creating volume b389833b-08e2-4095-b301-8aa906c15462 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:11:46 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b389833b-08e2-4095-b301-8aa906c15462 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:46 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df.bd12170e-171f-4011-8f71-0ff72158b380" returned: 0 in 0.764s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:46 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d5208d2f-80fd-4137-8ded-8085317a147a" returned: 0 in 0.781s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:46 devstack sudo[86984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b389833b-08e2-4095-b301-8aa906c15462 1073741824
Apr 27 15:11:46 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d5208d2f-80fd-4137-8ded-8085317a147a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Lock "cinder-quobyte-bd12170e-171f-4011-8f71-0ff72158b380" released by "_delete_snapshot" :: held 4.947s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Lock "cinder-quobyte-e73e2c0c-c141-4279-ba9f-61070f0556df" released by "delete_snapshot" :: held 4.985s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:46 devstack sudo[86986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d5208d2f-80fd-4137-8ded-8085317a147a
Apr 27 15:11:46 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Created reservations ['165dc9eb-6843-4b6b-b735-73c184119029', '25a77247-fb03-48ab-8ea5-e408cdb3e526', '410bbd5f-e44b-424a-9355-093ac2f02490', '0f4ceda8-7c2a-4120-bcf0-f3f868adc328'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:46 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Delete snapshot completed successfully.
Apr 27 15:11:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f94669d0-9222-435a-a27c-57a027f09e52 tempest-SnapshotMetadataTestJSON-770519212 None] Lock "cinder-bd12170e-171f-4011-8f71-0ff72158b380-delete_snapshot" released by "delete_snapshot" :: held 5.229s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Acquiring lock "cinder-e73e2c0c-c141-4279-ba9f-61070f0556df-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Lock "cinder-e73e2c0c-c141-4279-ba9f-61070f0556df-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Acquiring lock "cinder-quobyte-e73e2c0c-c141-4279-ba9f-61070f0556df" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Lock "cinder-quobyte-e73e2c0c-c141-4279-ba9f-61070f0556df" acquired by "delete_volume" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9dc717-c012-49ae-878b-19a88a75e611]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:47 devstack sudo[86990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df
Apr 27 15:11:47 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:47 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d5208d2f-80fd-4137-8ded-8085317a147a" returned: 0 in 0.657s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-d5208d2f-80fd-4137-8ded-8085317a147a" released by "delete_volume" :: held 1.500s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Created reservations ['25bc7012-9f2c-4eed-a975-d27e54f5aa0e', '0fadaeff-4a06-43ca-99a2-eae874b7c1cd', '2edfcf53-b5c3-4cbb-9220-11c3b2b34e12', '3d67a272-b933-4336-a031-965054840d0e'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:47 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b389833b-08e2-4095-b301-8aa906c15462 1073741824" returned: 0 in 0.904s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:47 devstack sudo[86995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:47 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b389833b-08e2-4095-b301-8aa906c15462 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:47 devstack sudo[86997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b389833b-08e2-4095-b301-8aa906c15462
Apr 27 15:11:47 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:47 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df" returned: 0 in 0.705s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:47 devstack sudo[87002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df
Apr 27 15:11:47 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-quobyte-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.554s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb" acquired by "delete_volume" :: waited 0.028s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:48 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:48 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Deleted volume successfully.
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[993cb40e-e89b-4cd2-ac11-c0a8bbac26a1]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b6efe9ae-1ebd-4ef0-aac2-69828597a583 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-d5208d2f-80fd-4137-8ded-8085317a147a-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:48 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b389833b-08e2-4095-b301-8aa906c15462" returned: 0 in 0.678s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19cc890-9895-4f2c-ae6e-b362850cd775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b389833b-08e2-4095-b301-8aa906c15462', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:48 devstack sudo[87009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb
Apr 27 15:11:48 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f00ffa8-1434-4f52-aeec-7aa81a9e17b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:48 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Volume volume-b389833b-08e2-4095-b301-8aa906c15462 (b389833b-08e2-4095-b301-8aa906c15462): created successfully
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f00ffa8-1434-4f52-aeec-7aa81a9e17b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Flow 'volume_create_manager' (2486336c-6fb0-4754-af1a-61885fd5308d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:48 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-33815a0b-9e91-4db4-a145-bb9b69f605ac tempest-VolumesActionsTest-2057272370 None] Created volume successfully.
Apr 27 15:11:48 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e73e2c0c-c141-4279-ba9f-61070f0556df" returned: 0 in 0.653s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Lock "cinder-quobyte-e73e2c0c-c141-4279-ba9f-61070f0556df" released by "delete_volume" :: held 1.423s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Created reservations ['af1b025b-e8aa-4c50-8e79-6c7f7e4f764d', '575c52c0-8009-4e2d-86ef-b36bb7d2cf7a', 'ea3fb029-9b4c-4377-a50d-5265ac1dac46', '4b94d549-5e2f-4691-83bf-1e628b447204'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:48 devstack sudo[87016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:48 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:48 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_service.periodic_task [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81538) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Acquiring lock "cinder-b389833b-08e2-4095-b301-8aa906c15462-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb" returned: 0 in 0.699s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:48 devstack sudo[87018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:48 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Lock "cinder-b389833b-08e2-4095-b301-8aa906c15462-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:48 devstack sudo[87020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb
Apr 27 15:11:48 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Acquiring lock "cinder-quobyte-b389833b-08e2-4095-b301-8aa906c15462" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Lock "cinder-quobyte-b389833b-08e2-4095-b301-8aa906c15462" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bec12c-f751-4180-92c1-f32227830e20]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b389833b-08e2-4095-b301-8aa906c15462 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:49 devstack sudo[87022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b389833b-08e2-4095-b301-8aa906c15462
Apr 27 15:11:49 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:49 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.464s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:49 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Deleted volume successfully.
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-62bdfc73-3ea9-4c24-91cb-e44dab262e85 tempest-SnapshotMetadataTestJSON-770519212 None] Lock "cinder-e73e2c0c-c141-4279-ba9f-61070f0556df-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:49 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.516s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:49 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb" returned: 0 in 0.565s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb" released by "delete_volume" :: held 1.346s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Created reservations ['103fd370-eaab-4b9f-adda-cf9465a0ae6a', '6a4f0d55-0efb-40b5-8965-b8c8d39a3fbb', '7436ebe2-ac02-491f-97f9-92a10c17fafb', 'a803b727-b531-4f2e-bc3a-60d8b01490bb'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:49 devstack sudo[87029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:49 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:49 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b389833b-08e2-4095-b301-8aa906c15462" returned: 0 in 0.761s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b389833b-08e2-4095-b301-8aa906c15462 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:49 devstack sudo[87035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b389833b-08e2-4095-b301-8aa906c15462
Apr 27 15:11:49 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:50 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.549s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:50 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Deleted volume successfully.
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a37bcb67-9465-4a7d-ae16-27d8a15fe3c7 tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-de88ae9d-6230-4f6d-93b0-5e7e4168f0fb-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:50 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b389833b-08e2-4095-b301-8aa906c15462" returned: 0 in 0.598s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-2a65e454-6f31-4bb8-aa06-f7f589ce44bd-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Lock "cinder-quobyte-b389833b-08e2-4095-b301-8aa906c15462" released by "delete_volume" :: held 1.417s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-2a65e454-6f31-4bb8-aa06-f7f589ce44bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-quobyte-595fad84-5cd3-4ec0-b0c2-ba60a5946761" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-595fad84-5cd3-4ec0-b0c2-ba60a5946761" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-quobyte-2a65e454-6f31-4bb8-aa06-f7f589ce44bd" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-2a65e454-6f31-4bb8-aa06-f7f589ce44bd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Deleting offline snapshot 2a65e454-6f31-4bb8-aa06-f7f589ce44bd of volume 595fad84-5cd3-4ec0-b0c2-ba60a5946761 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] snapshot_file for this snap is: volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[444111d2-135e-49db-94be-92fe8662af45]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Created reservations ['31e70d24-d628-44af-b477-02a0227e49ec', '2a0fde1c-762f-4e97-af0e-3fd310811f40', 'b9d4d3a1-8fe8-4215-977b-e8880fe78e42', 'a3aea482-deaf-41fe-9441-39f8373e588d'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:50 devstack sudo[87046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd
Apr 27 15:11:50 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:50 devstack sudo[87048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:50 devstack sudo[87048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:51 devstack sudo[87048]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.848s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:51 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:51 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Deleted volume successfully.
Apr 27 15:11:51 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd" returned: 0 in 1.015s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-c61232c1-23b3-40d0-8ca8-19c54dd66fa6 tempest-VolumesActionsTest-1493496986 None] Lock "cinder-b389833b-08e2-4095-b301-8aa906c15462-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:11:51 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e33c64d-750e-457e-8411-3eb4ab879afc]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:51 devstack sudo[87087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761
Apr 27 15:11:51 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Flow 'volume_create_manager' (bda1b298-1044-4574-9d80-7fae16f33307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b373be09-f247-4a79-a7d2-c33cb05be490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b373be09-f247-4a79-a7d2-c33cb05be490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-834130379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f71644-aa0e-4c14-990b-8b5433fab401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c7dd7060ad4c4291961df432d0e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:52Z,use_quota=True,user_id='8389dea4739b40c8979ae47cf6deaf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f60875-ad57-43f1-8bb4-eec2f4e30d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f60875-ad57-43f1-8bb4-eec2f4e30d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e130fe9-a840-42e1-937e-65e5fdf0b501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e130fe9-a840-42e1-937e-65e5fdf0b501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55f71644-aa0e-4c14-990b-8b5433fab401', 'volume_name': 'volume-55f71644-aa0e-4c14-990b-8b5433fab401', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb116f9-9329-4d33-aa90-263795bf705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb116f9-9329-4d33-aa90-263795bf705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12e6e71-2cb5-40ec-91ca-30c50347cff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:52 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Volume 55f71644-aa0e-4c14-990b-8b5433fab401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55f71644-aa0e-4c14-990b-8b5433fab401', 'volume_size': 1}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-834130379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f71644-aa0e-4c14-990b-8b5433fab401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c7dd7060ad4c4291961df432d0e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:52Z,use_quota=True,user_id='8389dea4739b40c8979ae47cf6deaf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Creating volume 55f71644-aa0e-4c14-990b-8b5433fab401 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:11:52 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-55f71644-aa0e-4c14-990b-8b5433fab401 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:52 devstack sudo[87091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-55f71644-aa0e-4c14-990b-8b5433fab401 1073741824
Apr 27 15:11:52 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Flow 'volume_create_manager' (784f9a3e-023e-456f-adef-078af3fdc76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f4d3a6-b5ab-49b0-8131-7c5130f95175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f4d3a6-b5ab-49b0-8131-7c5130f95175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-872619177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71a1730f10e4fc7b4ef24ffd4a3784c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:53Z,use_quota=True,user_id='61f00f3e666940cfbeb138580618c03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87a907c-750f-4351-a10c-2f2f53e423d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87a907c-750f-4351-a10c-2f2f53e423d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2809d96d-4bbc-4607-9eec-19c6a5d50aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2809d96d-4bbc-4607-9eec-19c6a5d50aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae', 'volume_name': 'volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3e0b52-c7fe-47ee-8086-fbab4ed5045e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3e0b52-c7fe-47ee-8086-fbab4ed5045e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5abbc6b-e47b-4c7f-8595-845e20538a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:52 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Volume 4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae', 'volume_size': 1}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:52 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761" returned: 0 in 1.238s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:52 devstack sudo[87100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd
Apr 27 15:11:52 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:53 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-55f71644-aa0e-4c14-990b-8b5433fab401 1073741824" returned: 0 in 0.819s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-55f71644-aa0e-4c14-990b-8b5433fab401 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:53 devstack sudo[87102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-55f71644-aa0e-4c14-990b-8b5433fab401
Apr 27 15:11:53 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:53 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd" returned: 0 in 0.691s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:53 devstack sudo[87108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd
Apr 27 15:11:53 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:53 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-55f71644-aa0e-4c14-990b-8b5433fab401" returned: 0 in 0.588s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.828s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-872619177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71a1730f10e4fc7b4ef24ffd4a3784c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:53Z,use_quota=True,user_id='61f00f3e666940cfbeb138580618c03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Creating volume 4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:11:53 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:53 devstack sudo[87110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae 1073741824
Apr 27 15:11:53 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c12e6e71-2cb5-40ec-91ca-30c50347cff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55f71644-aa0e-4c14-990b-8b5433fab401', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f686b7-dada-4ea8-a980-d13e575950ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:53 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Volume volume-55f71644-aa0e-4c14-990b-8b5433fab401 (55f71644-aa0e-4c14-990b-8b5433fab401): created successfully
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f686b7-dada-4ea8-a980-d13e575950ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Flow 'volume_create_manager' (bda1b298-1044-4574-9d80-7fae16f33307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:53 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-cb51a48f-d68d-4921-86d1-a7113c902722 tempest-VolumesActionsTest-2057272370 None] Created volume successfully.
Apr 27 15:11:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Acquiring lock "cinder-55f71644-aa0e-4c14-990b-8b5433fab401-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Lock "cinder-55f71644-aa0e-4c14-990b-8b5433fab401-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:54 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761.2a65e454-6f31-4bb8-aa06-f7f589ce44bd" returned: 0 in 0.977s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Acquiring lock "cinder-quobyte-55f71644-aa0e-4c14-990b-8b5433fab401" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Lock "cinder-quobyte-55f71644-aa0e-4c14-990b-8b5433fab401" acquired by "delete_volume" :: waited 0.050s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:54 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-2a65e454-6f31-4bb8-aa06-f7f589ce44bd" released by "_delete_snapshot" :: held 4.148s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:54 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2a17c6-7c7f-4ff5-95df-7918f2fcf494]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-595fad84-5cd3-4ec0-b0c2-ba60a5946761" released by "delete_snapshot" :: held 4.184s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-55f71644-aa0e-4c14-990b-8b5433fab401 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae 1073741824" returned: 0 in 0.959s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:54 devstack sudo[87116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-55f71644-aa0e-4c14-990b-8b5433fab401
Apr 27 15:11:54 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:54 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Created reservations ['79c53c78-6d43-4313-a1b3-7fe6f416eea6', '76bd451a-3464-454a-a01b-0512d5e39e54', '39c9fd4f-6166-4b13-808c-6383bcf3ed97', 'e078c4b2-066c-4bf3-bd0e-c50790162639'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:54 devstack sudo[87117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae
Apr 27 15:11:54 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:54 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Delete snapshot completed successfully.
Apr 27 15:11:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-13d6259c-07b7-43e4-92c3-f08f510df55f tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-2a65e454-6f31-4bb8-aa06-f7f589ce44bd-delete_snapshot" released by "delete_snapshot" :: held 4.457s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:55 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-55f71644-aa0e-4c14-990b-8b5433fab401" returned: 0 in 0.689s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-55f71644-aa0e-4c14-990b-8b5433fab401 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:55 devstack sudo[87125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-55f71644-aa0e-4c14-990b-8b5433fab401
Apr 27 15:11:55 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:55 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" returned: 0 in 0.725s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5abbc6b-e47b-4c7f-8595-845e20538a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184f8ce3-55ba-4178-9594-0a9e5a22206e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:55 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Volume volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae (4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae): created successfully
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184f8ce3-55ba-4178-9594-0a9e5a22206e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Flow 'volume_create_manager' (784f9a3e-023e-456f-adef-078af3fdc76d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:55 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ac6b35cb-9084-4ce3-babd-259a67cd4a30 tempest-VolumesDeleteCascade-591528920 None] Created volume successfully.
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-595fad84-5cd3-4ec0-b0c2-ba60a5946761-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-595fad84-5cd3-4ec0-b0c2-ba60a5946761-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "cinder-quobyte-595fad84-5cd3-4ec0-b0c2-ba60a5946761" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-595fad84-5cd3-4ec0-b0c2-ba60a5946761" acquired by "delete_volume" :: waited 0.014s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f008e9da-dad4-4c80-8d2f-f89c520bd8f3]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:55 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-55f71644-aa0e-4c14-990b-8b5433fab401" returned: 0 in 0.545s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Lock "cinder-quobyte-55f71644-aa0e-4c14-990b-8b5433fab401" released by "delete_volume" :: held 1.297s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Created reservations ['fadb1d78-2375-49ce-a479-12a20f1671f4', '335a495b-a8c5-4e3c-82d5-5d6cdf576718', 'b71e26d9-4b70-4620-8b31-930d1cadbfb7', 'c2ee12f6-a1aa-42fd-8177-10015de00378'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:55 devstack sudo[87128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761
Apr 27 15:11:55 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:56 devstack sudo[87130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:56 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] Creating offline snapshot 1c9db940-777e-4c81-a782-ee6303d76930 of volume 4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:11:56 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7129f3c-fdcf-49a2-ac2c-34f4815f0f8b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:11:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:56 devstack sudo[87138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae
Apr 27 15:11:56 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:56 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.820s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:56 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:56 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Deleted volume successfully.
Apr 27 15:11:56 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3f9493cc-e3ab-45f2-a653-793fb1f6f2dc tempest-VolumesActionsTest-1493496986 None] Lock "cinder-55f71644-aa0e-4c14-990b-8b5433fab401-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:56 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761" returned: 0 in 1.119s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:56 devstack sudo[87167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761
Apr 27 15:11:56 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Flow 'volume_create_manager' (bb37b3db-5f4c-4d1c-9cb0-fc51d027cbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76035145-d21f-44aa-9446-42b48c214e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76035145-d21f-44aa-9446-42b48c214e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1424104318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3f4e20-5117-4c41-9f78-adff3bd36df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c7dd7060ad4c4291961df432d0e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:57Z,use_quota=True,user_id='8389dea4739b40c8979ae47cf6deaf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65bb1338-3324-4553-968c-384e6cf44413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65bb1338-3324-4553-968c-384e6cf44413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279cc828-80db-4ce5-bd55-4c7fc60f983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279cc828-80db-4ce5-bd55-4c7fc60f983e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3f4e20-5117-4c41-9f78-adff3bd36df2', 'volume_name': 'volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6adcf5a6-d8db-4e5b-a389-57c82f7a438e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6adcf5a6-d8db-4e5b-a389-57c82f7a438e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2559d06-94f5-455a-848d-b81dee5603cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:11:57 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Volume 5b3f4e20-5117-4c41-9f78-adff3bd36df2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2', 'volume_size': 1}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:57 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" returned: 0 in 1.140s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:57 devstack sudo[87174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 1G
Apr 27 15:11:57 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:57 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-595fad84-5cd3-4ec0-b0c2-ba60a5946761" returned: 0 in 0.670s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-quobyte-595fad84-5cd3-4ec0-b0c2-ba60a5946761" released by "delete_volume" :: held 1.861s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Created reservations ['27022162-3d99-4214-9550-19139b43b7d3', '52dd58dc-63fd-4478-9d64-53d50e57772b', '147fa0dd-855b-4ba8-a443-119f80d4fb6f', 'ea2478bd-5def-43a3-a456-f02ed4ad9aad'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:11:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:57 devstack sudo[87178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:11:57 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:58 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 1G" returned: 0 in 0.959s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:58 devstack sudo[87222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930
Apr 27 15:11:58 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:58 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.847s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:58 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:11:58 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Deleted volume successfully.
Apr 27 15:11:58 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cdf21e9d-1f18-4d07-9702-61ec3e4bb84e tempest-CreateVolumesFromSnapshotTest-772180983 None] Lock "cinder-595fad84-5cd3-4ec0-b0c2-ba60a5946761-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:11:59 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930" returned: 0 in 0.648s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:59 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 is being set with open permissions: ugo+rw
Apr 27 15:11:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:59 devstack sudo[87229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930
Apr 27 15:11:59 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:11:59 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root
Apr 27 15:11:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930" returned: 0 in 0.534s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:11:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:11:59 devstack sudo[87232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.info
Apr 27 15:11:59 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:00 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.info" returned: 0 in 0.541s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:00 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.info is being set with open permissions: ugo+rw
Apr 27 15:12:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:00 devstack sudo[87235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.info
Apr 27 15:12:00 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:00 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.info" returned: 0 in 0.538s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.517s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.376s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1424104318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3f4e20-5117-4c41-9f78-adff3bd36df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c7dd7060ad4c4291961df432d0e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:11:57Z,use_quota=True,user_id='8389dea4739b40c8979ae47cf6deaf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Creating volume 5b3f4e20-5117-4c41-9f78-adff3bd36df2 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:00 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:00 devstack sudo[87238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2 1073741824
Apr 27 15:12:00 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:00 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-9d72d246-06e7-4d58-a6a1-f3a6f9f72fb7 tempest-VolumesDeleteCascade-591528920 None] Create snapshot completed successfully
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Flow 'volume_create_manager' (081b8007-e267-47dc-a805-cae040533862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7551d97-d5a5-404d-a563-edce711447dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7551d97-d5a5-404d-a563-edce711447dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1717905854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0deaa713-6d44-40c6-9203-5c90b0040e42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f25065518e40f29fb25dfb110202e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:01Z,use_quota=True,user_id='9f32e838a5bb4b82917426302940318b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b117b839-ac52-4040-9898-dc1f59e79019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b117b839-ac52-4040-9898-dc1f59e79019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706b406f-02bc-4d35-a9b5-63f3a323fabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706b406f-02bc-4d35-a9b5-63f3a323fabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0deaa713-6d44-40c6-9203-5c90b0040e42', 'volume_name': 'volume-0deaa713-6d44-40c6-9203-5c90b0040e42', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6305e11-f450-42fe-9ad1-6275017cee01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6305e11-f450-42fe-9ad1-6275017cee01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef787727-fdbc-42fd-8421-a90ce4832d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:01 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume 0deaa713-6d44-40c6-9203-5c90b0040e42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0deaa713-6d44-40c6-9203-5c90b0040e42', 'volume_size': 1}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:01 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2 1073741824" returned: 0 in 0.712s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:01 devstack sudo[87243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2
Apr 27 15:12:01 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:01 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2" returned: 0 in 0.487s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.684s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1717905854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0deaa713-6d44-40c6-9203-5c90b0040e42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f25065518e40f29fb25dfb110202e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:01Z,use_quota=True,user_id='9f32e838a5bb4b82917426302940318b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Creating volume 0deaa713-6d44-40c6-9203-5c90b0040e42 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:01 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0deaa713-6d44-40c6-9203-5c90b0040e42 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2559d06-94f5-455a-848d-b81dee5603cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:01 devstack sudo[87247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0deaa713-6d44-40c6-9203-5c90b0040e42 1073741824
Apr 27 15:12:01 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84644ca4-b765-49eb-a6f0-ce0ac233e9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:02 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Volume volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2 (5b3f4e20-5117-4c41-9f78-adff3bd36df2): created successfully
Apr 27 15:12:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84644ca4-b765-49eb-a6f0-ce0ac233e9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Flow 'volume_create_manager' (bb37b3db-5f4c-4d1c-9cb0-fc51d027cbf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:02 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-c600bd65-19cd-41ba-be08-8f690585da87 tempest-VolumesActionsTest-2057272370 None] Created volume successfully.
Apr 27 15:12:02 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0deaa713-6d44-40c6-9203-5c90b0040e42 1073741824" returned: 0 in 0.668s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:02 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=167,cinder:INSERT=63,cinder:UPDATE=226,cinder:DELETE=15 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:12:02 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:INSERT=45,cinder:SELECT=133,cinder:UPDATE=174,cinder:DELETE=19 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:12:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0deaa713-6d44-40c6-9203-5c90b0040e42 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:02 devstack sudo[87252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0deaa713-6d44-40c6-9203-5c90b0040e42
Apr 27 15:12:02 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Acquiring lock "cinder-5b3f4e20-5117-4c41-9f78-adff3bd36df2-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Lock "cinder-5b3f4e20-5117-4c41-9f78-adff3bd36df2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Acquiring lock "cinder-quobyte-5b3f4e20-5117-4c41-9f78-adff3bd36df2" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Lock "cinder-quobyte-5b3f4e20-5117-4c41-9f78-adff3bd36df2" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:02 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[302038b0-7229-429a-848b-9e620130a278]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:02 devstack sudo[87254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2
Apr 27 15:12:02 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:03 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0deaa713-6d44-40c6-9203-5c90b0040e42" returned: 0 in 0.541s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.584s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] Creating offline snapshot a8faff38-cbca-4f69-b89c-8432fb7ff3fd of volume 4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef787727-fdbc-42fd-8421-a90ce4832d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0deaa713-6d44-40c6-9203-5c90b0040e42', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbcb5f6-cf23-49c0-b353-fc6c79e4346f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c27ad4-9729-4216-98f9-a82a03080bb0]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:03 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume volume-0deaa713-6d44-40c6-9203-5c90b0040e42 (0deaa713-6d44-40c6-9203-5c90b0040e42): created successfully
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbcb5f6-cf23-49c0-b353-fc6c79e4346f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Flow 'volume_create_manager' (081b8007-e267-47dc-a805-cae040533862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:03 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-c64e3185-80cb-4b04-b34d-6ece9b74f1a7 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Created volume successfully.
Apr 27 15:12:03 devstack sudo[87257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930
Apr 27 15:12:03 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:03 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2" returned: 0 in 0.647s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:03 devstack sudo[87262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2
Apr 27 15:12:03 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Flow 'volume_create_manager' (28621114-3d61-43b4-9099-885da07dfd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ab3d98-f8db-4988-b779-394fb6d13f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ab3d98-f8db-4988-b779-394fb6d13f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-752076470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b66b87-7129-468c-89ae-9fbad7f57917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f54ea4df444c01bd89c2b2a2a9d2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:04Z,use_quota=True,user_id='a6a68c2868c34cd580440227f3992743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fae123-9a59-4fc2-9b73-d13886186337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fae123-9a59-4fc2-9b73-d13886186337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb78cfec-7557-4ba0-94ec-7d05a7de5585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb78cfec-7557-4ba0-94ec-7d05a7de5585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b66b87-7129-468c-89ae-9fbad7f57917', 'volume_name': 'volume-72b66b87-7129-468c-89ae-9fbad7f57917', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8b0d78-cfed-4652-b17d-f9fd60225efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8b0d78-cfed-4652-b17d-f9fd60225efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7771a6ed-bcd4-4f4c-890c-b48041c0a2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:03 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Volume 72b66b87-7129-468c-89ae-9fbad7f57917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b66b87-7129-468c-89ae-9fbad7f57917', 'volume_size': 1}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:03 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930" returned: 0 in 0.631s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:12:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:03 devstack sudo[87268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd 1G
Apr 27 15:12:03 devstack sudo[87268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:04 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5b3f4e20-5117-4c41-9f78-adff3bd36df2" returned: 0 in 0.488s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Lock "cinder-quobyte-5b3f4e20-5117-4c41-9f78-adff3bd36df2" released by "delete_volume" :: held 1.190s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Created reservations ['59b5079a-7e47-43ff-8463-d21644d4356a', '4a5e0119-021a-43e8-b26d-c3120b60520a', 'c30dbe5a-8030-4b34-80d0-b1fc67ca518c', '638a98b4-4b4b-4bbd-89c6-eae8934db82e'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:04 devstack sudo[87270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:04 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:04 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Flow 'volume_create_manager' (df09eeaa-8c9c-4596-acca-591d47706d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b174ddef-a517-4a42-b884-d9cf13893656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.565s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:04 devstack sudo[87268]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b174ddef-a517-4a42-b884-d9cf13893656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-643638919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea44df7-4e7e-4f4c-aab7-004445c855f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f25065518e40f29fb25dfb110202e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:05Z,use_quota=True,user_id='9f32e838a5bb4b82917426302940318b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d47cf7c-60f2-46ed-bd4d-96c222d0bde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d47cf7c-60f2-46ed-bd4d-96c222d0bde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036127ee-d2d4-489c-b74d-840206fbd4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036127ee-d2d4-489c-b74d-840206fbd4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ea44df7-4e7e-4f4c-aab7-004445c855f0', 'volume_name': 'volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817e4651-ffbe-4385-9e57-731401f5c081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817e4651-ffbe-4385-9e57-731401f5c081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1816d12-780a-4f0a-9687-18ef823c47e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:04 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume 9ea44df7-4e7e-4f4c-aab7-004445c855f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0', 'volume_size': 1}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:04 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Deleted volume successfully.
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd 1G" returned: 0 in 0.837s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0865b8b5-aea5-4e43-a4c2-24e8138ddedc tempest-VolumesActionsTest-1493496986 None] Lock "cinder-5b3f4e20-5117-4c41-9f78-adff3bd36df2-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:04 devstack sudo[87276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd
Apr 27 15:12:04 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Flow 'volume_create_manager' (5e4409a0-bbf1-4df8-b630-d921a64a582e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf8cbfe-84d3-4598-871f-fe08552b61b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf8cbfe-84d3-4598-871f-fe08552b61b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1792423581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7782f25c-70ed-4019-ba44-e35e429eaccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f25065518e40f29fb25dfb110202e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:05Z,use_quota=True,user_id='9f32e838a5bb4b82917426302940318b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19d3ece-1186-4932-b05c-94555c0b7906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19d3ece-1186-4932-b05c-94555c0b7906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a832babf-19a4-4976-87a3-5b01d0b8359c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a832babf-19a4-4976-87a3-5b01d0b8359c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7782f25c-70ed-4019-ba44-e35e429eaccf', 'volume_name': 'volume-7782f25c-70ed-4019-ba44-e35e429eaccf', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203e22d8-04a9-4ef7-a44d-1675833bf038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203e22d8-04a9-4ef7-a44d-1675833bf038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070db21d-6b70-46ba-98d9-7c9213a520a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume 7782f25c-70ed-4019-ba44-e35e429eaccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7782f25c-70ed-4019-ba44-e35e429eaccf', 'volume_size': 1}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Flow 'volume_create_manager' (9237aed0-ce2e-4e8f-947a-aba95ca06d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf29bdb-c858-42a9-81c0-649b3fc7db7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf29bdb-c858-42a9-81c0-649b3fc7db7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1692672683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c813f03-a7fc-4a65-b108-c5453c53137e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f25065518e40f29fb25dfb110202e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:05Z,use_quota=True,user_id='9f32e838a5bb4b82917426302940318b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e233ea-0279-4f5c-9a62-cafea44cd392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e233ea-0279-4f5c-9a62-cafea44cd392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9cd812-99d1-453b-ad66-23e236d5614e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9cd812-99d1-453b-ad66-23e236d5614e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c813f03-a7fc-4a65-b108-c5453c53137e', 'volume_name': 'volume-0c813f03-a7fc-4a65-b108-c5453c53137e', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667a32f8-4fc9-4938-a381-e8044ad19bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667a32f8-4fc9-4938-a381-e8044ad19bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb335fed-c229-4235-b9b4-ad5247ea72ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume 0c813f03-a7fc-4a65-b108-c5453c53137e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c813f03-a7fc-4a65-b108-c5453c53137e', 'volume_size': 1}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:05 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd" returned: 0 in 0.689s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:05 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd is being set with open permissions: ugo+rw
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:05 devstack sudo[87281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd
Apr 27 15:12:05 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Flow 'volume_create_manager' (29f29d50-f2eb-4d14-b58b-e60e9b41c660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493c7db8-79ec-4073-a10d-c541121308ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493c7db8-79ec-4073-a10d-c541121308ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-278280908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1444c9a9-d19d-40b1-9015-515a775e25c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c7dd7060ad4c4291961df432d0e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:05Z,use_quota=True,user_id='8389dea4739b40c8979ae47cf6deaf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f59c8a6-60a2-4c75-b4a0-76db782b5c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f59c8a6-60a2-4c75-b4a0-76db782b5c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d195c542-b86d-4cfb-add2-6233352b4037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d195c542-b86d-4cfb-add2-6233352b4037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1444c9a9-d19d-40b1-9015-515a775e25c9', 'volume_name': 'volume-1444c9a9-d19d-40b1-9015-515a775e25c9', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ad29ec-7d31-4feb-89e8-5d339844e133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ad29ec-7d31-4feb-89e8-5d339844e133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0336d250-656e-4a16-8cc3-794e0594e254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Volume 1444c9a9-d19d-40b1-9015-515a775e25c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1444c9a9-d19d-40b1-9015-515a775e25c9', 'volume_size': 1}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Flow 'volume_create_manager' (cdaea983-52ac-4974-a928-a39ab33863cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e895be-97ee-4f63-87a1-46339e6b3fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e895be-97ee-4f63-87a1-46339e6b3fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1052139598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987d53fa-358a-47e8-a39b-cebed3ca9bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f25065518e40f29fb25dfb110202e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:06Z,use_quota=True,user_id='9f32e838a5bb4b82917426302940318b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce5aad40-3038-44f3-92d8-4d3e2aca37da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce5aad40-3038-44f3-92d8-4d3e2aca37da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da22240-f3f8-482b-a2ff-ba7e00799701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da22240-f3f8-482b-a2ff-ba7e00799701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '987d53fa-358a-47e8-a39b-cebed3ca9bdf', 'volume_name': 'volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627bccc0-ad88-43b7-8d12-de717cf619ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627bccc0-ad88-43b7-8d12-de717cf619ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a569ee-2932-4a99-8177-007a213bc883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume 987d53fa-358a-47e8-a39b-cebed3ca9bdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf', 'volume_size': 1}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Flow 'volume_create_manager' (1e1969b8-2eca-4166-b18d-1b92f033781c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90b495c-72a9-4575-8e6b-b23296814fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90b495c-72a9-4575-8e6b-b23296814fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1153978561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b817c54-c183-4d08-896c-3a3f4bfb754f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f25065518e40f29fb25dfb110202e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:06Z,use_quota=True,user_id='9f32e838a5bb4b82917426302940318b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6a80cd-5424-4db8-a153-60b6d1720b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6a80cd-5424-4db8-a153-60b6d1720b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e6c367-c969-4a19-b14c-3e7e01533dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e6c367-c969-4a19-b14c-3e7e01533dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b817c54-c183-4d08-896c-3a3f4bfb754f', 'volume_name': 'volume-8b817c54-c183-4d08-896c-3a3f4bfb754f', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bed7480-5fd6-4da8-bee6-666835da94ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bed7480-5fd6-4da8-bee6-666835da94ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a770f6d6-8cf5-4757-a71c-dda0c0b0c094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:05 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume 8b817c54-c183-4d08-896c-3a3f4bfb754f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b817c54-c183-4d08-896c-3a3f4bfb754f', 'volume_size': 1}
Apr 27 15:12:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:06 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd" returned: 0 in 0.551s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.822s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.398s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-752076470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b66b87-7129-468c-89ae-9fbad7f57917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f54ea4df444c01bd89c2b2a2a9d2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:04Z,use_quota=True,user_id='a6a68c2868c34cd580440227f3992743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Creating volume 72b66b87-7129-468c-89ae-9fbad7f57917 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:06 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-72b66b87-7129-468c-89ae-9fbad7f57917 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:06 devstack sudo[87284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-72b66b87-7129-468c-89ae-9fbad7f57917 1073741824
Apr 27 15:12:06 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:06 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-57d3ae1f-3572-40ab-afae-d520e6417d61 tempest-VolumesDeleteCascade-591528920 None] Create snapshot completed successfully
Apr 27 15:12:06 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-72b66b87-7129-468c-89ae-9fbad7f57917 1073741824" returned: 0 in 0.613s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-72b66b87-7129-468c-89ae-9fbad7f57917 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:06 devstack sudo[87289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-72b66b87-7129-468c-89ae-9fbad7f57917
Apr 27 15:12:06 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Performing cascade delete. {{(pid=81538) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-1c9db940-777e-4c81-a782-ee6303d76930-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-1c9db940-777e-4c81-a782-ee6303d76930-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-quobyte-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-quobyte-1c9db940-777e-4c81-a782-ee6303d76930" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-1c9db940-777e-4c81-a782-ee6303d76930" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Deleting offline snapshot 1c9db940-777e-4c81-a782-ee6303d76930 of volume 4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] snapshot_file for this snap is: volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[68300716-7910-424f-a5b6-d71bdd6777cd]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:07 devstack sudo[87291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930
Apr 27 15:12:07 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:07 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-72b66b87-7129-468c-89ae-9fbad7f57917" returned: 0 in 0.488s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.426s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-643638919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea44df7-4e7e-4f4c-aab7-004445c855f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f25065518e40f29fb25dfb110202e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:05Z,use_quota=True,user_id='9f32e838a5bb4b82917426302940318b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Creating volume 9ea44df7-4e7e-4f4c-aab7-004445c855f0 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:07 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7771a6ed-bcd4-4f4c-890c-b48041c0a2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b66b87-7129-468c-89ae-9fbad7f57917', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:07 devstack sudo[87294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0 1073741824
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7921c777-9452-4219-896f-e2d4986a506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:07 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:07 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Volume volume-72b66b87-7129-468c-89ae-9fbad7f57917 (72b66b87-7129-468c-89ae-9fbad7f57917): created successfully
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7921c777-9452-4219-896f-e2d4986a506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Flow 'volume_create_manager' (28621114-3d61-43b4-9099-885da07dfd48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:07 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5127947e-aa8d-4f3e-8f8b-04d5f91de769 tempest-ServersNegativeTestJSON-859844277 None] Created volume successfully.
Apr 27 15:12:07 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930" returned: 0 in 0.526s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[deff004f-9dc9-4445-90d8-058937ea3433]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:07 devstack sudo[87301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae
Apr 27 15:12:07 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:07 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0 1073741824" returned: 0 in 0.641s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:07 devstack sudo[87304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0
Apr 27 15:12:07 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:08 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" returned: 0 in 0.625s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[948ddda1-ce5c-4f1f-9110-6379a2eeebca]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:08 devstack sudo[87310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd
Apr 27 15:12:08 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:08 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0" returned: 0 in 0.502s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.314s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1792423581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7782f25c-70ed-4019-ba44-e35e429eaccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f25065518e40f29fb25dfb110202e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:05Z,use_quota=True,user_id='9f32e838a5bb4b82917426302940318b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Creating volume 7782f25c-70ed-4019-ba44-e35e429eaccf {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:08 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7782f25c-70ed-4019-ba44-e35e429eaccf 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1816d12-780a-4f0a-9687-18ef823c47e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:08 devstack sudo[87313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7782f25c-70ed-4019-ba44-e35e429eaccf 1073741824
Apr 27 15:12:08 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d3888c-91c4-4b32-a24a-5da648b3ea2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:08 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0 (9ea44df7-4e7e-4f4c-aab7-004445c855f0): created successfully
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d3888c-91c4-4b32-a24a-5da648b3ea2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Flow 'volume_create_manager' (df09eeaa-8c9c-4596-acca-591d47706d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:08 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-43bef78d-9842-48ae-8095-bfa9b6c96526 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Created volume successfully.
Apr 27 15:12:08 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd" returned: 0 in 0.675s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Flow 'volume_create_manager' (062bc667-1a21-4b97-9c96-c050dbae88c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80132d8-7258-4519-a016-3cf8bd00a85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01580de-920e-4cbf-8dfb-5010a5ae69d6]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80132d8-7258-4519-a016-3cf8bd00a85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-958608190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f54ea4df444c01bd89c2b2a2a9d2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:09Z,use_quota=True,user_id='a6a68c2868c34cd580440227f3992743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e7984a-813b-44bc-ad6e-fc554a960d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e7984a-813b-44bc-ad6e-fc554a960d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa09e453-4fff-4e26-92b1-b50900e02c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa09e453-4fff-4e26-92b1-b50900e02c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc', 'volume_name': 'volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4d36a8-4522-49c1-b3b0-6e9a8448e064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4d36a8-4522-49c1-b3b0-6e9a8448e064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc77039-46c6-4de3-a60c-ea73b200e144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:09 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Volume 52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc', 'volume_size': 1}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:09 devstack sudo[87321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930
Apr 27 15:12:09 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:09 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7782f25c-70ed-4019-ba44-e35e429eaccf 1073741824" returned: 0 in 0.779s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7782f25c-70ed-4019-ba44-e35e429eaccf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:09 devstack sudo[87323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7782f25c-70ed-4019-ba44-e35e429eaccf
Apr 27 15:12:09 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:09 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930" returned: 0 in 0.537s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cb3847-7b4a-4a2f-94e6-1c56ed7c54a6]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:09 devstack sudo[87328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae
Apr 27 15:12:09 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:09 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7782f25c-70ed-4019-ba44-e35e429eaccf" returned: 0 in 0.482s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.290s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1692672683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c813f03-a7fc-4a65-b108-c5453c53137e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f25065518e40f29fb25dfb110202e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:05Z,use_quota=True,user_id='9f32e838a5bb4b82917426302940318b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Creating volume 0c813f03-a7fc-4a65-b108-c5453c53137e {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:09 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0c813f03-a7fc-4a65-b108-c5453c53137e 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070db21d-6b70-46ba-98d9-7c9213a520a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7782f25c-70ed-4019-ba44-e35e429eaccf', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:09 devstack sudo[87331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0c813f03-a7fc-4a65-b108-c5453c53137e 1073741824
Apr 27 15:12:09 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b943a3c3-ad54-4c8b-af27-efbcd0705f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:09 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume volume-7782f25c-70ed-4019-ba44-e35e429eaccf (7782f25c-70ed-4019-ba44-e35e429eaccf): created successfully
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b943a3c3-ad54-4c8b-af27-efbcd0705f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Flow 'volume_create_manager' (5e4409a0-bbf1-4df8-b630-d921a64a582e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:09 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-76835ded-93a8-48ce-9537-995ab1580933 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Created volume successfully.
Apr 27 15:12:10 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" returned: 0 in 0.570s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:10 devstack sudo[87339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930
Apr 27 15:12:10 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:10 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0c813f03-a7fc-4a65-b108-c5453c53137e 1073741824" returned: 0 in 0.656s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0c813f03-a7fc-4a65-b108-c5453c53137e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:10 devstack sudo[87341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0c813f03-a7fc-4a65-b108-c5453c53137e
Apr 27 15:12:10 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:10 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930" returned: 0 in 0.574s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:10 devstack sudo[87346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930
Apr 27 15:12:10 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:10 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0c813f03-a7fc-4a65-b108-c5453c53137e" returned: 0 in 0.481s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.289s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-278280908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1444c9a9-d19d-40b1-9015-515a775e25c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c7dd7060ad4c4291961df432d0e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:05Z,use_quota=True,user_id='8389dea4739b40c8979ae47cf6deaf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Creating volume 1444c9a9-d19d-40b1-9015-515a775e25c9 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:10 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1444c9a9-d19d-40b1-9015-515a775e25c9 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:10 devstack sudo[87349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1444c9a9-d19d-40b1-9015-515a775e25c9 1073741824
Apr 27 15:12:10 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb335fed-c229-4235-b9b4-ad5247ea72ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c813f03-a7fc-4a65-b108-c5453c53137e', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68659c1d-3559-4c99-bfb4-efc2480a99e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:10 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume volume-0c813f03-a7fc-4a65-b108-c5453c53137e (0c813f03-a7fc-4a65-b108-c5453c53137e): created successfully
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68659c1d-3559-4c99-bfb4-efc2480a99e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Flow 'volume_create_manager' (9237aed0-ce2e-4e8f-947a-aba95ca06d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:10 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-05c52a85-1d22-4792-96bc-6271a8751513 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Created volume successfully.
Apr 27 15:12:11 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.1c9db940-777e-4c81-a782-ee6303d76930" returned: 0 in 0.437s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd -F qcow2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:11 devstack sudo[87352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd -F qcow2
Apr 27 15:12:11 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:11 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1444c9a9-d19d-40b1-9015-515a775e25c9 1073741824" returned: 0 in 0.647s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1444c9a9-d19d-40b1-9015-515a775e25c9 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:11 devstack sudo[87357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1444c9a9-d19d-40b1-9015-515a775e25c9
Apr 27 15:12:11 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:11 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd -F qcow2" returned: 0 in 0.563s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-1c9db940-777e-4c81-a782-ee6303d76930" released by "_delete_snapshot" :: held 4.761s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" released by "delete_snapshot" :: held 4.787s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Created reservations ['227c74ac-9daa-4e75-9f3a-ac732f328ace', '2027b678-3c0f-4586-a4b4-6180e5d36468', '45a6877e-4033-496f-bffa-64bf78e2c55f', '9b0a3a5a-1ac3-4288-ad25-292a27959073'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:11 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Delete snapshot completed successfully.
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-1c9db940-777e-4c81-a782-ee6303d76930-delete_snapshot" released by "delete_snapshot" :: held 4.923s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-a8faff38-cbca-4f69-b89c-8432fb7ff3fd-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-a8faff38-cbca-4f69-b89c-8432fb7ff3fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-quobyte-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-quobyte-a8faff38-cbca-4f69-b89c-8432fb7ff3fd" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-a8faff38-cbca-4f69-b89c-8432fb7ff3fd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Deleting offline snapshot a8faff38-cbca-4f69-b89c-8432fb7ff3fd of volume 4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:12:11 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] snapshot_file for this snap is: volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da340e6-1aca-4fce-87dd-3ba1ee16eb16]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:12 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1444c9a9-d19d-40b1-9015-515a775e25c9" returned: 0 in 0.477s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.342s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1052139598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987d53fa-358a-47e8-a39b-cebed3ca9bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f25065518e40f29fb25dfb110202e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:06Z,use_quota=True,user_id='9f32e838a5bb4b82917426302940318b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:12 devstack sudo[87363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd
Apr 27 15:12:12 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Creating volume 987d53fa-358a-47e8-a39b-cebed3ca9bdf {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:12 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0336d250-656e-4a16-8cc3-794e0594e254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1444c9a9-d19d-40b1-9015-515a775e25c9', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e3239e-943a-4088-8b24-9121eccc4020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:12 devstack sudo[87365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf 1073741824
Apr 27 15:12:12 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:12 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Volume volume-1444c9a9-d19d-40b1-9015-515a775e25c9 (1444c9a9-d19d-40b1-9015-515a775e25c9): created successfully
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e3239e-943a-4088-8b24-9121eccc4020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Flow 'volume_create_manager' (29f29d50-f2eb-4d14-b58b-e60e9b41c660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:12 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-88496620-bec3-41da-ad64-b5549ae2af31 tempest-VolumesActionsTest-2057272370 None] Created volume successfully.
Apr 27 15:12:12 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd" returned: 0 in 0.570s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c62aa57-a93f-4608-b160-2e2eb0dbe3fd]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:12 devstack sudo[87373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae
Apr 27 15:12:12 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:12 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf 1073741824" returned: 0 in 0.639s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:12 devstack sudo[87375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf
Apr 27 15:12:12 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:13 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" returned: 0 in 0.610s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:13 devstack sudo[87381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd
Apr 27 15:12:13 devstack sudo[87381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:13 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf" returned: 0 in 0.482s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.347s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1153978561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b817c54-c183-4d08-896c-3a3f4bfb754f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f25065518e40f29fb25dfb110202e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:06Z,use_quota=True,user_id='9f32e838a5bb4b82917426302940318b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Creating volume 8b817c54-c183-4d08-896c-3a3f4bfb754f {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:13 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8b817c54-c183-4d08-896c-3a3f4bfb754f 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a569ee-2932-4a99-8177-007a213bc883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c7900a-3046-40b9-aec4-ca86c2bc9a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:13 devstack sudo[87383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8b817c54-c183-4d08-896c-3a3f4bfb754f 1073741824
Apr 27 15:12:13 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:13 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf (987d53fa-358a-47e8-a39b-cebed3ca9bdf): created successfully
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c7900a-3046-40b9-aec4-ca86c2bc9a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Flow 'volume_create_manager' (cdaea983-52ac-4974-a928-a39ab33863cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:13 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-8f05cb9d-8442-4d09-9104-e1e85525b2dc tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Created volume successfully.
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Acquiring lock "cinder-1444c9a9-d19d-40b1-9015-515a775e25c9-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Lock "cinder-1444c9a9-d19d-40b1-9015-515a775e25c9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Acquiring lock "cinder-quobyte-1444c9a9-d19d-40b1-9015-515a775e25c9" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Lock "cinder-quobyte-1444c9a9-d19d-40b1-9015-515a775e25c9" acquired by "delete_volume" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[469485eb-999c-4745-9269-6e55cf6c19ba]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1444c9a9-d19d-40b1-9015-515a775e25c9 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:13 devstack sudo[87387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1444c9a9-d19d-40b1-9015-515a775e25c9
Apr 27 15:12:13 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:13 devstack sudo[87381]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd" returned: 0 in 0.637s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:13 devstack sudo[87393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd
Apr 27 15:12:13 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:14 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8b817c54-c183-4d08-896c-3a3f4bfb754f 1073741824" returned: 0 in 0.771s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8b817c54-c183-4d08-896c-3a3f4bfb754f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:14 devstack sudo[87395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8b817c54-c183-4d08-896c-3a3f4bfb754f
Apr 27 15:12:14 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:14 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1444c9a9-d19d-40b1-9015-515a775e25c9" returned: 0 in 0.613s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1444c9a9-d19d-40b1-9015-515a775e25c9 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:14 devstack sudo[87401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1444c9a9-d19d-40b1-9015-515a775e25c9
Apr 27 15:12:14 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:14 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae.a8faff38-cbca-4f69-b89c-8432fb7ff3fd" returned: 0 in 0.480s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-a8faff38-cbca-4f69-b89c-8432fb7ff3fd" released by "_delete_snapshot" :: held 2.388s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" released by "delete_snapshot" :: held 2.413s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Created reservations ['1552ee82-0f78-4675-aac3-8b5343176eec', '67c3ac4f-a1fb-451f-95f5-b6f7377f9193', 'eba70503-cf80-467b-9347-01d054b65c09', 'fa599a59-0474-424f-b110-218ea5598ea0'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:14 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Delete snapshot completed successfully.
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-a8faff38-cbca-4f69-b89c-8432fb7ff3fd-delete_snapshot" released by "delete_snapshot" :: held 2.577s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Snapshots deleted, issuing volume delete {{(pid=81538) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-quobyte-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b10bf3-fb22-4914-aeb1-782a4ad3e4b3]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:14 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8b817c54-c183-4d08-896c-3a3f4bfb754f" returned: 0 in 0.525s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.545s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-958608190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f54ea4df444c01bd89c2b2a2a9d2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:09Z,use_quota=True,user_id='a6a68c2868c34cd580440227f3992743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Creating volume 52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:14 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:14 devstack sudo[87405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc 1073741824
Apr 27 15:12:14 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:14 devstack sudo[87404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a770f6d6-8cf5-4757-a71c-dda0c0b0c094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b817c54-c183-4d08-896c-3a3f4bfb754f', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:14 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbeb82cb-cf17-4875-9318-1264e822d505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:14 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Volume volume-8b817c54-c183-4d08-896c-3a3f4bfb754f (8b817c54-c183-4d08-896c-3a3f4bfb754f): created successfully
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbeb82cb-cf17-4875-9318-1264e822d505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Flow 'volume_create_manager' (1e1969b8-2eca-4166-b18d-1b92f033781c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:14 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-51cb700e-dd90-4998-aceb-4b948096c5e0 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Created volume successfully.
Apr 27 15:12:14 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1444c9a9-d19d-40b1-9015-515a775e25c9" returned: 0 in 0.541s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Lock "cinder-quobyte-1444c9a9-d19d-40b1-9015-515a775e25c9" released by "delete_volume" :: held 1.190s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Created reservations ['1b6649c0-d8a2-4905-8578-5af40c07d010', 'b08d189b-9fde-4961-bfb9-6510940c9da8', 'ed5045ce-0d6c-4bfa-ab15-faaaacdeeb44', '45ae4ddc-ea72-410e-aad8-c65bdc4683d7'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:14 devstack sudo[87409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:14 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:15 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" returned: 0 in 0.601s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:15 devstack sudo[87417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae
Apr 27 15:12:15 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:15 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc 1073741824" returned: 0 in 0.689s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:15 devstack sudo[87419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc
Apr 27 15:12:15 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:15 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.542s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:15 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Deleted volume successfully.
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-220f2418-c9f1-4724-9d70-61f831d85c74 tempest-VolumesActionsTest-2057272370 None] Lock "cinder-1444c9a9-d19d-40b1-9015-515a775e25c9-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:15 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" returned: 0 in 0.490s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae" released by "delete_volume" :: held 1.146s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Created reservations ['8bd36168-43ea-4f2c-8e1d-83c3396e05f2', '32c21c29-7903-4341-b7d1-a57ea7d5bbde', '7a20bbd5-c98b-4ea8-81e1-f1861fb7ee6e', 'cc050aa6-bcb5-4229-8c0d-7bc7de939432'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "cinder-8b817c54-c183-4d08-896c-3a3f4bfb754f-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-8b817c54-c183-4d08-896c-3a3f4bfb754f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:15 devstack sudo[87424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:15 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:15 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc" returned: 0 in 0.551s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "cinder-quobyte-8b817c54-c183-4d08-896c-3a3f4bfb754f" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc77039-46c6-4de3-a60c-ea73b200e144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9a41cd-8607-4ef7-857f-0e6327e52ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-quobyte-8b817c54-c183-4d08-896c-3a3f4bfb754f" acquired by "delete_volume" :: waited 0.032s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:15 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Volume volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc (52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc): created successfully
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9a41cd-8607-4ef7-857f-0e6327e52ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Flow 'volume_create_manager' (062bc667-1a21-4b97-9c96-c050dbae88c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf155564-fec7-4f55-8255-25ebc2d5cdd9]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8b817c54-c183-4d08-896c-3a3f4bfb754f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:15 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b01c9b97-ba33-4a24-9e8c-e60f87251571 tempest-ServersNegativeTestJSON-859844277 None] Created volume successfully.
Apr 27 15:12:16 devstack sudo[87426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8b817c54-c183-4d08-896c-3a3f4bfb754f
Apr 27 15:12:16 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:16 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.516s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:16 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:16 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Deleted volume successfully.
Apr 27 15:12:16 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8db406df-a881-4dc6-a442-7bf2f6f39ae2 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-4a9e6e6b-1dc5-41de-88c9-b94b66abc3ae-delete_volume" released by "delete_volume" :: held 9.417s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:16 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8b817c54-c183-4d08-896c-3a3f4bfb754f" returned: 0 in 0.761s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8b817c54-c183-4d08-896c-3a3f4bfb754f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:16 devstack sudo[87434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8b817c54-c183-4d08-896c-3a3f4bfb754f
Apr 27 15:12:16 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:16 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Acquiring lock "cinder-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:16 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Lock "cinder-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:16 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Acquiring lock "cinder-quobyte-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:16 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Lock "cinder-quobyte-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc" acquired by "delete_volume" :: waited 0.027s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acec370-8fce-496c-bbc0-6ace9a478e97]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:17 devstack sudo[87436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc
Apr 27 15:12:17 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Flow 'volume_create_manager' (14fba2f9-4d1f-4389-98bc-481c3bf651b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c46e08-6cc4-4136-bb29-1317e3f2fb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c46e08-6cc4-4136-bb29-1317e3f2fb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2043336520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0e9687-ebbe-44ed-b575-297e63b6c887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71a1730f10e4fc7b4ef24ffd4a3784c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:17Z,use_quota=True,user_id='61f00f3e666940cfbeb138580618c03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec183f6-8251-47f5-8fd8-783d143004b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec183f6-8251-47f5-8fd8-783d143004b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899cb6f6-fd03-4df6-ac3e-6eafd44e5d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899cb6f6-fd03-4df6-ac3e-6eafd44e5d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0e9687-ebbe-44ed-b575-297e63b6c887', 'volume_name': 'volume-be0e9687-ebbe-44ed-b575-297e63b6c887', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5495a0-6c30-4630-beb5-4369cb7936fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5495a0-6c30-4630-beb5-4369cb7936fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41664c80-88e4-4a7a-af31-8da06fa304bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:17 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Volume be0e9687-ebbe-44ed-b575-297e63b6c887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0e9687-ebbe-44ed-b575-297e63b6c887', 'volume_size': 1}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2043336520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0e9687-ebbe-44ed-b575-297e63b6c887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71a1730f10e4fc7b4ef24ffd4a3784c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:17Z,use_quota=True,user_id='61f00f3e666940cfbeb138580618c03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Creating volume be0e9687-ebbe-44ed-b575-297e63b6c887 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:17 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:17 devstack sudo[87439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887 1073741824
Apr 27 15:12:17 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:17 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8b817c54-c183-4d08-896c-3a3f4bfb754f" returned: 0 in 0.618s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-quobyte-8b817c54-c183-4d08-896c-3a3f4bfb754f" released by "delete_volume" :: held 1.425s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Created reservations ['b6648049-9d23-421f-8591-0b1577078a05', '061ae360-aeed-498e-9cec-b6956f783d9e', '196d440a-b8ac-49d6-8220-b2f5a11a3856', 'b438c73c-f41b-48cc-9e41-5463ebebff45'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:17 devstack sudo[87444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:17 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:17 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc" returned: 0 in 0.567s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:17 devstack sudo[87446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc
Apr 27 15:12:17 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:18 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.501s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:18 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Deleted volume successfully.
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fe41d66c-e099-4015-9955-0b238cdf7fe4 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-8b817c54-c183-4d08-896c-3a3f4bfb754f-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "cinder-987d53fa-358a-47e8-a39b-cebed3ca9bdf-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-987d53fa-358a-47e8-a39b-cebed3ca9bdf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:18 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "cinder-quobyte-987d53fa-358a-47e8-a39b-cebed3ca9bdf" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc" returned: 0 in 0.598s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-quobyte-987d53fa-358a-47e8-a39b-cebed3ca9bdf" acquired by "delete_volume" :: waited 0.028s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Lock "cinder-quobyte-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc" released by "delete_volume" :: held 1.234s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d79ba3-3fc4-4453-96e9-831f11e50e0e]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:18 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887 1073741824" returned: 0 in 0.955s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Created reservations ['2a250c47-90c1-48c5-bad6-7200fd4d81aa', '13c08168-ad7e-45f8-aea7-34f69016eb3a', 'c8d3e781-b54b-4375-9774-910dd4b6992e', 'b0fa735f-0618-46c4-9bf5-30c4ad4782c5'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:18 devstack sudo[87456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887
Apr 27 15:12:18 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:18 devstack sudo[87455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf
Apr 27 15:12:18 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:18 devstack sudo[87459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:18 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:18 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887" returned: 0 in 0.489s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41664c80-88e4-4a7a-af31-8da06fa304bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0e9687-ebbe-44ed-b575-297e63b6c887', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22ea255-0a83-4ba3-9dfc-1ff8ad5d157c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:18 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Volume volume-be0e9687-ebbe-44ed-b575-297e63b6c887 (be0e9687-ebbe-44ed-b575-297e63b6c887): created successfully
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22ea255-0a83-4ba3-9dfc-1ff8ad5d157c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Flow 'volume_create_manager' (14fba2f9-4d1f-4389-98bc-481c3bf651b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:18 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e1cacd22-21a6-4be6-8ede-cbb03d2fbe6b tempest-VolumesDeleteCascade-591528920 None] Created volume successfully.
Apr 27 15:12:18 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf" returned: 0 in 0.709s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:18 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.558s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:18 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:18 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Deleted volume successfully.
Apr 27 15:12:18 devstack sudo[87466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf
Apr 27 15:12:18 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-eb3dbaa5-9e22-4da6-bb9e-73b92e708c8d tempest-ServersNegativeTestJSON-859844277 None] Lock "cinder-52e3d0e9-e8f4-4b05-9d17-f2f67de0cefc-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Acquiring lock "cinder-72b66b87-7129-468c-89ae-9fbad7f57917-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Lock "cinder-72b66b87-7129-468c-89ae-9fbad7f57917-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Acquiring lock "cinder-quobyte-72b66b87-7129-468c-89ae-9fbad7f57917" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Lock "cinder-quobyte-72b66b87-7129-468c-89ae-9fbad7f57917" acquired by "delete_volume" :: waited 0.044s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbee60b5-d88e-4964-bec0-ea582bc549be]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-72b66b87-7129-468c-89ae-9fbad7f57917 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:19 devstack sudo[87469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-72b66b87-7129-468c-89ae-9fbad7f57917
Apr 27 15:12:19 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:19 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-987d53fa-358a-47e8-a39b-cebed3ca9bdf" returned: 0 in 0.699s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-quobyte-987d53fa-358a-47e8-a39b-cebed3ca9bdf" released by "delete_volume" :: held 1.455s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] Creating offline snapshot e8a6ea0f-4291-425a-a47b-c7089b2ffc39 of volume be0e9687-ebbe-44ed-b575-297e63b6c887 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b1d8dc-e405-40f1-b539-e917c5093114]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Created reservations ['06f8a33a-7f5b-4de6-81ce-b3f739587312', '4052418f-64c6-4d50-a968-f5033c27d15e', '8a0ea49f-e447-4c93-bcd4-b0125e63851f', '784b8af3-9f61-4870-812d-8edcc66c5984'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:19 devstack sudo[87471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887
Apr 27 15:12:19 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:19 devstack sudo[87473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:19 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:20 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-72b66b87-7129-468c-89ae-9fbad7f57917" returned: 0 in 0.664s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-72b66b87-7129-468c-89ae-9fbad7f57917 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:20 devstack sudo[87479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-72b66b87-7129-468c-89ae-9fbad7f57917
Apr 27 15:12:20 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "cinder-0c813f03-a7fc-4a65-b108-c5453c53137e-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-0c813f03-a7fc-4a65-b108-c5453c53137e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "cinder-quobyte-0c813f03-a7fc-4a65-b108-c5453c53137e" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-quobyte-0c813f03-a7fc-4a65-b108-c5453c53137e" acquired by "delete_volume" :: waited 0.050s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bb8a49-5900-4e45-b047-39eb4b179a8b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0c813f03-a7fc-4a65-b108-c5453c53137e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:20 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.768s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:20 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Deleted volume successfully.
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a7e5c48b-aafa-4c25-a440-6708afd32c91 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-987d53fa-358a-47e8-a39b-cebed3ca9bdf-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:20 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887" returned: 0 in 0.920s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:20 devstack sudo[87485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0c813f03-a7fc-4a65-b108-c5453c53137e
Apr 27 15:12:20 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:20 devstack sudo[87486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39 1G
Apr 27 15:12:20 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:20 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-72b66b87-7129-468c-89ae-9fbad7f57917" returned: 0 in 0.656s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Lock "cinder-quobyte-72b66b87-7129-468c-89ae-9fbad7f57917" released by "delete_volume" :: held 1.379s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Created reservations ['e9404ff7-16b6-42af-a208-8fe535067af9', '79965463-30a5-49be-bb34-7fad950384b9', '40544dae-9890-48c4-bc58-2a1278881787', '3a40af03-7aa4-473b-9358-881283805d80'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:20 devstack sudo[87490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:20 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:21 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0c813f03-a7fc-4a65-b108-c5453c53137e" returned: 0 in 0.680s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0c813f03-a7fc-4a65-b108-c5453c53137e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:21 devstack sudo[87498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0c813f03-a7fc-4a65-b108-c5453c53137e
Apr 27 15:12:21 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:21 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39 1G" returned: 0 in 0.718s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0e9687-ebbe-44ed-b575-297e63b6c887 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:21 devstack sudo[87501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0e9687-ebbe-44ed-b575-297e63b6c887 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39
Apr 27 15:12:21 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:21 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.530s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:21 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:21 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Deleted volume successfully.
Apr 27 15:12:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4ae81a17-342e-49a7-b8ca-2678e15747e8 tempest-ServersNegativeTestJSON-859844277 None] Lock "cinder-72b66b87-7129-468c-89ae-9fbad7f57917-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:21 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0c813f03-a7fc-4a65-b108-c5453c53137e" returned: 0 in 0.559s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-quobyte-0c813f03-a7fc-4a65-b108-c5453c53137e" released by "delete_volume" :: held 1.293s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:21 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Created reservations ['1074f852-cd48-403f-9480-e61f00d02cf3', '3f58df3e-e364-45ca-b958-ecca2b37bb59', 'b26cab1c-0805-4bbc-be59-41a57c0f5214', '867b391d-ca4f-4486-b9a6-4acda7390b83'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:22 devstack sudo[87508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:22 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:22 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0e9687-ebbe-44ed-b575-297e63b6c887 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39" returned: 0 in 0.735s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:22 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39 is being set with open permissions: ugo+rw
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:22 devstack sudo[87511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39
Apr 27 15:12:22 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:22 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.478s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:22 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Deleted volume successfully.
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6cc6945e-9f48-4586-8717-abc98b34ace3 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-0c813f03-a7fc-4a65-b108-c5453c53137e-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:22 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39" returned: 0 in 0.520s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "cinder-7782f25c-70ed-4019-ba44-e35e429eaccf-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:22 devstack sudo[87515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.info
Apr 27 15:12:22 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-7782f25c-70ed-4019-ba44-e35e429eaccf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "cinder-quobyte-7782f25c-70ed-4019-ba44-e35e429eaccf" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-quobyte-7782f25c-70ed-4019-ba44-e35e429eaccf" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e5cfca-9c0a-4b40-b5e0-1f8a57d523c6]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7782f25c-70ed-4019-ba44-e35e429eaccf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:22 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7782f25c-70ed-4019-ba44-e35e429eaccf
Apr 27 15:12:22 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:23 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.info" returned: 0 in 0.677s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:23 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.info is being set with open permissions: ugo+rw
Apr 27 15:12:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:23 devstack sudo[87549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.info
Apr 27 15:12:23 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:23 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7782f25c-70ed-4019-ba44-e35e429eaccf" returned: 0 in 0.819s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7782f25c-70ed-4019-ba44-e35e429eaccf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:23 devstack sudo[87554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7782f25c-70ed-4019-ba44-e35e429eaccf
Apr 27 15:12:23 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:24 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.info" returned: 0 in 0.706s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.393s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:24 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ba74a4b8-cc01-4482-9781-88774ba5520a tempest-VolumesDeleteCascade-591528920 None] Create snapshot completed successfully
Apr 27 15:12:24 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7782f25c-70ed-4019-ba44-e35e429eaccf" returned: 0 in 0.587s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-quobyte-7782f25c-70ed-4019-ba44-e35e429eaccf" released by "delete_volume" :: held 1.446s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Created reservations ['ee06ff42-258c-4df2-a80a-8ad53682f8fd', '9f3ff21f-d3b2-4a11-8ce3-00bfc2c571e0', '02139f09-9a05-49d9-bbe1-6fc936d99236', '03b7b214-fcd3-4584-aaf8-13ca90dcfdc6'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:24 devstack sudo[87559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:24 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:24 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.561s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:24 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Deleted volume successfully.
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f88d52ca-79aa-40b4-b00b-b7e96fd8ce35 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-7782f25c-70ed-4019-ba44-e35e429eaccf-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "cinder-9ea44df7-4e7e-4f4c-aab7-004445c855f0-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-9ea44df7-4e7e-4f4c-aab7-004445c855f0-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "cinder-quobyte-9ea44df7-4e7e-4f4c-aab7-004445c855f0" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-quobyte-9ea44df7-4e7e-4f4c-aab7-004445c855f0" acquired by "delete_volume" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe68625-ea34-488e-945c-613136adec50]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:25 devstack sudo[87565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0
Apr 27 15:12:25 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Flow 'volume_create_manager' (32d0b1a2-e17c-4067-b881-edb001713160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8b3803-110d-49a5-bc04-9431c5200476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8b3803-110d-49a5-bc04-9431c5200476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-98692434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c30753c-7fe1-4da4-be96-d575640bd7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b71a1730f10e4fc7b4ef24ffd4a3784c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e8a6ea0f-4291-425a-a47b-c7089b2ffc39,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:26Z,use_quota=True,user_id='61f00f3e666940cfbeb138580618c03b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f119d1b-40b3-45b4-8f84-802c55c6cb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f119d1b-40b3-45b4-8f84-802c55c6cb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea550b7-fe75-427e-adc6-2ae6951a60f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea550b7-fe75-427e-adc6-2ae6951a60f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2c30753c-7fe1-4da4-be96-d575640bd7b1', 'volume_name': 'volume-2c30753c-7fe1-4da4-be96-d575640bd7b1', 'volume_size': 1, 'snapshot_id': 'e8a6ea0f-4291-425a-a47b-c7089b2ffc39'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a000da7-0470-493f-bdd5-f1da1baa6349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a000da7-0470-493f-bdd5-f1da1baa6349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19fabaca-31c4-45f6-9afe-26c963c0b113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:25 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Volume 2c30753c-7fe1-4da4-be96-d575640bd7b1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2c30753c-7fe1-4da4-be96-d575640bd7b1', 'volume_size': 1, 'snapshot_id': 'e8a6ea0f-4291-425a-a47b-c7089b2ffc39'}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-quobyte-e8a6ea0f-4291-425a-a47b-c7089b2ffc39-2c30753c-7fe1-4da4-be96-d575640bd7b1" by "_create_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-e8a6ea0f-4291-425a-a47b-c7089b2ffc39-2c30753c-7fe1-4da4-be96-d575640bd7b1" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Creating volume 2c30753c-7fe1-4da4-be96-d575640bd7b1 from snapshot e8a6ea0f-4291-425a-a47b-c7089b2ffc39 {{(pid=81538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-quobyte-2c30753c-7fe1-4da4-be96-d575640bd7b1" by "_copy_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-2c30753c-7fe1-4da4-be96-d575640bd7b1" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] snapshot: e8a6ea0f-4291-425a-a47b-c7089b2ffc39, volume: 2c30753c-7fe1-4da4-be96-d575640bd7b1,  {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bc6835-17cd-47ca-934b-978fe51ddbf4]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:25 devstack sudo[87569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39
Apr 27 15:12:25 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:25 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0" returned: 0 in 0.718s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:25 devstack sudo[87572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0
Apr 27 15:12:25 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:26 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39" returned: 0 in 0.640s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be0e9687-ebbe-44ed-b575-297e63b6c887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887 {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Creating direct copy from snapshot {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb61bf1-ec0f-492d-8d1e-a04f6a704f10]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:26 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ea44df7-4e7e-4f4c-aab7-004445c855f0" returned: 0 in 0.554s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-quobyte-9ea44df7-4e7e-4f4c-aab7-004445c855f0" released by "delete_volume" :: held 1.346s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Created reservations ['4d23e268-03cf-4b13-bb97-282f7d3f7181', 'd256ec09-51d0-4352-8acd-9332c0a1091d', '4d8de2b8-445c-4f9b-add4-de1d129d7108', '9fa00a28-c0a7-4ffa-8444-230e547dffe4'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:26 devstack sudo[87578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887
Apr 27 15:12:26 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:26 devstack sudo[87580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:26 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:27 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887" returned: 0 in 0.650s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:27 devstack cinder-volume[81538]: DEBUG cinder.utils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Path /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1 not found in is_blk_device check {{(pid=81538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 27 15:12:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:27 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.522s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:27 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:27 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Deleted volume successfully.
Apr 27 15:12:27 devstack sudo[87586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1
Apr 27 15:12:27 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ca4b73ca-31c0-4210-a27b-ab89defd0ebd tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-9ea44df7-4e7e-4f4c-aab7-004445c855f0-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "cinder-0deaa713-6d44-40c6-9203-5c90b0040e42-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-0deaa713-6d44-40c6-9203-5c90b0040e42-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "cinder-quobyte-0deaa713-6d44-40c6-9203-5c90b0040e42" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-quobyte-0deaa713-6d44-40c6-9203-5c90b0040e42" acquired by "delete_volume" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:27 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a0adac-5433-4a99-b407-7b90042c6c31]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0deaa713-6d44-40c6-9203-5c90b0040e42 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:27 devstack sudo[87588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0deaa713-6d44-40c6-9203-5c90b0040e42
Apr 27 15:12:27 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:28 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0deaa713-6d44-40c6-9203-5c90b0040e42" returned: 0 in 0.744s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0deaa713-6d44-40c6-9203-5c90b0040e42 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:28 devstack sudo[87603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0deaa713-6d44-40c6-9203-5c90b0040e42
Apr 27 15:12:28 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:29 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0deaa713-6d44-40c6-9203-5c90b0040e42" returned: 0 in 1.446s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:29 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-quobyte-0deaa713-6d44-40c6-9203-5c90b0040e42" released by "delete_volume" :: held 2.249s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:29 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Created reservations ['d9e24dad-0f06-47eb-ac90-b41fe791cdc9', '560bef10-6163-4bfd-be5a-d24b8c760e5e', 'c99f69f0-4ece-4ce5-ae65-f127f5de89ad', '73818f28-588f-4ab7-a2ea-b003f84328d6'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:30 devstack sudo[87607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:30 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:31 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 1.488s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:31 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:31 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Deleted volume successfully.
Apr 27 15:12:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9549e95c-5505-499a-bfde-aa644be22213 tempest-CreateVolumesFromSourceVolumeTest-1544469230 None] Lock "cinder-0deaa713-6d44-40c6-9203-5c90b0040e42-delete_volume" released by "delete_volume" :: held 4.181s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:31 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Flow 'volume_create_manager' (7c2b3fbd-9486-491a-89dc-24ba97919489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6232787-42a1-427d-b621-7f0c3c5d2e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6232787-42a1-427d-b621-7f0c3c5d2e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1200727270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9ffaf858b24dffbcdbd5b90c2a0a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:32Z,use_quota=True,user_id='6c6496266d214a1fbe1977e90c32b329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba95aeda-02fc-4470-9da9-79f61397d76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba95aeda-02fc-4470-9da9-79f61397d76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaae3637-9534-4097-998b-c1529cdeb93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaae3637-9534-4097-998b-c1529cdeb93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b', 'volume_name': 'volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce2bb8e-a34d-468c-9885-80fdfc03c71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce2bb8e-a34d-468c-9885-80fdfc03c71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:32 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b6a401-7778-409e-a5b0-055d3b856746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:32 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Volume a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b', 'volume_size': 1}
Apr 27 15:12:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:33 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1" returned: 0 in 6.387s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:33 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7352c38-cf1b-4b1b-bebe-2f2b0db2f87a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:33 devstack sudo[87614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887
Apr 27 15:12:33 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:34 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887" returned: 0 in 0.843s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:34 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1 {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:12:34 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Converted 1024.00 MB image at 160.29 MB/s
Apr 27 15:12:34 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1 is being set with open permissions: ugo+rw
Apr 27 15:12:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:34 devstack sudo[87622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1
Apr 27 15:12:34 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:34 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1" returned: 0 in 0.592s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:34 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-2c30753c-7fe1-4da4-be96-d575640bd7b1" released by "_copy_volume_from_snapshot" :: held 9.231s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-e8a6ea0f-4291-425a-a47b-c7089b2ffc39-2c30753c-7fe1-4da4-be96-d575640bd7b1" released by "_create_volume_from_snapshot" :: held 9.287s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.316s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.874s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1200727270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9ffaf858b24dffbcdbd5b90c2a0a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:32Z,use_quota=True,user_id='6c6496266d214a1fbe1977e90c32b329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Creating volume a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:35 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:35 devstack sudo[87625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b 1073741824
Apr 27 15:12:35 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19fabaca-31c4-45f6-9afe-26c963c0b113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c30753c-7fe1-4da4-be96-d575640bd7b1', 'volume_size': 1, 'snapshot_id': 'e8a6ea0f-4291-425a-a47b-c7089b2ffc39'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b7578f-5d7d-43fd-b684-dea464ed4398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:35 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Volume volume-2c30753c-7fe1-4da4-be96-d575640bd7b1 (2c30753c-7fe1-4da4-be96-d575640bd7b1): created successfully
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b7578f-5d7d-43fd-b684-dea464ed4398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Flow 'volume_create_manager' (32d0b1a2-e17c-4067-b881-edb001713160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:35 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5abfa300-c713-4bc4-b4e9-70eeb607a4d5 tempest-VolumesDeleteCascade-591528920 None] Created volume successfully.
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Flow 'volume_create_manager' (9c3f06d7-633a-4e17-8c44-c2e202a45a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba624ee-26c8-4ef6-8a00-1fa6640e120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba624ee-26c8-4ef6-8a00-1fa6640e120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff3b039-59db-48d4-a82d-955ef38397ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f0cb0cb86447d1b247eb28a4f149e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:35Z,use_quota=True,user_id='970f6a1ef4134e0d9fee5a47f907fd7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e3954c-38ef-4c46-9ee7-d7e45c67671d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e3954c-38ef-4c46-9ee7-d7e45c67671d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9e337f-a4b1-400c-878d-caa76041af08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9e337f-a4b1-400c-878d-caa76041af08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff3b039-59db-48d4-a82d-955ef38397ef', 'volume_name': 'volume-5ff3b039-59db-48d4-a82d-955ef38397ef', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8b6d08-5031-419c-b838-c1975793a53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8b6d08-5031-419c-b838-c1975793a53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13258b54-ca8f-4fc7-8345-b43a8f7f59c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:35 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Volume 5ff3b039-59db-48d4-a82d-955ef38397ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff3b039-59db-48d4-a82d-955ef38397ef', 'volume_size': 1}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-be0e9687-ebbe-44ed-b575-297e63b6c887-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-be0e9687-ebbe-44ed-b575-297e63b6c887-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Performing cascade delete. {{(pid=81538) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-e8a6ea0f-4291-425a-a47b-c7089b2ffc39-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-e8a6ea0f-4291-425a-a47b-c7089b2ffc39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-quobyte-be0e9687-ebbe-44ed-b575-297e63b6c887" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-be0e9687-ebbe-44ed-b575-297e63b6c887" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-quobyte-e8a6ea0f-4291-425a-a47b-c7089b2ffc39" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-e8a6ea0f-4291-425a-a47b-c7089b2ffc39" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Deleting offline snapshot e8a6ea0f-4291-425a-a47b-c7089b2ffc39 of volume be0e9687-ebbe-44ed-b575-297e63b6c887 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:12:35 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] snapshot_file for this snap is: volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b 1073741824" returned: 0 in 0.810s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e299bc4-9f86-4adb-aea3-d592fa708117]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:35 devstack sudo[87632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b
Apr 27 15:12:35 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:35 devstack sudo[87631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39
Apr 27 15:12:35 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:36 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b" returned: 0 in 0.528s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.165s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff3b039-59db-48d4-a82d-955ef38397ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f0cb0cb86447d1b247eb28a4f149e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:35Z,use_quota=True,user_id='970f6a1ef4134e0d9fee5a47f907fd7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Creating volume 5ff3b039-59db-48d4-a82d-955ef38397ef {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:36 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5ff3b039-59db-48d4-a82d-955ef38397ef 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:36 devstack sudo[87639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5ff3b039-59db-48d4-a82d-955ef38397ef 1073741824
Apr 27 15:12:36 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b6a401-7778-409e-a5b0-055d3b856746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24282c7f-2d76-4d63-b71f-04a934ecce66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:36 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Volume volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b (a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b): created successfully
Apr 27 15:12:36 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24282c7f-2d76-4d63-b71f-04a934ecce66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Flow 'volume_create_manager' (7c2b3fbd-9486-491a-89dc-24ba97919489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39" returned: 0 in 0.671s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be0e9687-ebbe-44ed-b575-297e63b6c887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:12:36 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-50e85d8e-f2f6-4845-bac1-222fd04fa5cd tempest-VolumesListAdminTestJSON-2082956035 None] Created volume successfully.
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19cf172-dab9-44aa-8fb0-aa2da4d90464]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:36 devstack sudo[87641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887
Apr 27 15:12:36 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:37 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5ff3b039-59db-48d4-a82d-955ef38397ef 1073741824" returned: 0 in 0.703s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5ff3b039-59db-48d4-a82d-955ef38397ef {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:37 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887" returned: 0 in 0.635s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:37 devstack sudo[87649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5ff3b039-59db-48d4-a82d-955ef38397ef
Apr 27 15:12:37 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:37 devstack sudo[87651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39
Apr 27 15:12:37 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Flow 'volume_create_manager' (79f1c3f0-9dec-408e-9c38-2113059cc180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388f73b2-6fe0-43df-996b-9301e7a1054d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388f73b2-6fe0-43df-996b-9301e7a1054d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1902308582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0266d8-8214-419b-930b-30d3f71e407e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9ffaf858b24dffbcdbd5b90c2a0a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:38Z,use_quota=True,user_id='6c6496266d214a1fbe1977e90c32b329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fe9a23-6e1f-490d-bc13-adc8f9793b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fe9a23-6e1f-490d-bc13-adc8f9793b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399971e5-3e0d-46a1-a998-a1fff2f247f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399971e5-3e0d-46a1-a998-a1fff2f247f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d0266d8-8214-419b-930b-30d3f71e407e', 'volume_name': 'volume-0d0266d8-8214-419b-930b-30d3f71e407e', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2defb121-f95a-4ce4-8612-c43ff702a32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2defb121-f95a-4ce4-8612-c43ff702a32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff04dd6-f57d-4104-aed5-bd0cfda2de87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:37 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Volume 0d0266d8-8214-419b-930b-30d3f71e407e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d0266d8-8214-419b-930b-30d3f71e407e', 'volume_size': 1}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:37 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5ff3b039-59db-48d4-a82d-955ef38397ef" returned: 0 in 0.623s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1902308582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0266d8-8214-419b-930b-30d3f71e407e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9ffaf858b24dffbcdbd5b90c2a0a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:38Z,use_quota=True,user_id='6c6496266d214a1fbe1977e90c32b329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Creating volume 0d0266d8-8214-419b-930b-30d3f71e407e {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:37 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0d0266d8-8214-419b-930b-30d3f71e407e 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13258b54-ca8f-4fc7-8345-b43a8f7f59c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff3b039-59db-48d4-a82d-955ef38397ef', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:37 devstack sudo[87657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0d0266d8-8214-419b-930b-30d3f71e407e 1073741824
Apr 27 15:12:37 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283096ee-522f-491f-a1fd-8e3f6d61bc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:37 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Volume volume-5ff3b039-59db-48d4-a82d-955ef38397ef (5ff3b039-59db-48d4-a82d-955ef38397ef): created successfully
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283096ee-522f-491f-a1fd-8e3f6d61bc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Flow 'volume_create_manager' (9c3f06d7-633a-4e17-8c44-c2e202a45a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:37 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-140bf9c8-baea-41b3-b417-7e5ab10a951b tempest-CinderUnicodeTest-338666064 None] Created volume successfully.
Apr 27 15:12:38 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39" returned: 0 in 0.798s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:38 devstack sudo[87659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39
Apr 27 15:12:38 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:38 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887.e8a6ea0f-4291-425a-a47b-c7089b2ffc39" returned: 0 in 0.595s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:38 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-e8a6ea0f-4291-425a-a47b-c7089b2ffc39" released by "_delete_snapshot" :: held 2.833s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0d0266d8-8214-419b-930b-30d3f71e407e 1073741824" returned: 0 in 0.820s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-be0e9687-ebbe-44ed-b575-297e63b6c887" released by "delete_snapshot" :: held 2.859s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0d0266d8-8214-419b-930b-30d3f71e407e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:38 devstack sudo[87666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0d0266d8-8214-419b-930b-30d3f71e407e
Apr 27 15:12:38 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:38 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Created reservations ['fe8ea81a-4b95-49a2-81cc-5014f3785331', 'ca4c2089-c22b-4ff9-84b5-f1f16d0a4d0b', 'c177e5fe-6301-488e-8415-8d04fdbeabb8', '7023752e-3c9f-423b-b16a-19f9da41c8bd'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:38 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Delete snapshot completed successfully.
Apr 27 15:12:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-e8a6ea0f-4291-425a-a47b-c7089b2ffc39-delete_snapshot" released by "delete_snapshot" :: held 3.089s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Snapshots deleted, issuing volume delete {{(pid=81538) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 27 15:12:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-quobyte-be0e9687-ebbe-44ed-b575-297e63b6c887" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-be0e9687-ebbe-44ed-b575-297e63b6c887" acquired by "delete_volume" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:38 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f21890f-e862-458f-895d-3721983b4151]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:39 devstack sudo[87668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887
Apr 27 15:12:39 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Flow 'volume_create_manager' (f030aa3e-ffd1-4e3a-ab01-21ba02a4c682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f432256-01f1-4274-94cf-6872826ef8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f432256-01f1-4274-94cf-6872826ef8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-219005494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900a7b56-e765-493c-bea8-732fc7062fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f0cb0cb86447d1b247eb28a4f149e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:39Z,use_quota=True,user_id='970f6a1ef4134e0d9fee5a47f907fd7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756a37ca-7632-4369-ba8a-e9a68c55ab9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756a37ca-7632-4369-ba8a-e9a68c55ab9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e246152a-99e7-4f16-9a65-45f9f4b4a4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e246152a-99e7-4f16-9a65-45f9f4b4a4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '900a7b56-e765-493c-bea8-732fc7062fdd', 'volume_name': 'volume-900a7b56-e765-493c-bea8-732fc7062fdd', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9148fe-89b2-4611-81a8-c38588980761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9148fe-89b2-4611-81a8-c38588980761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2821efa-47e5-4838-b8b1-a1adfb139e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:39 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Volume 900a7b56-e765-493c-bea8-732fc7062fdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-900a7b56-e765-493c-bea8-732fc7062fdd', 'volume_size': 1}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e824c063-d3df-4f41-abbf-a58d1b79c2fb tempest-GroupsTest-1189300331 None] Group tempest-Group1-1873619844: creating
Apr 27 15:12:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e824c063-d3df-4f41-abbf-a58d1b79c2fb tempest-GroupsTest-1189300331 None] Group tempest-Group1-1873619844: created successfully
Apr 27 15:12:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e824c063-d3df-4f41-abbf-a58d1b79c2fb tempest-GroupsTest-1189300331 None] Create group completed successfully.
Apr 27 15:12:39 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0d0266d8-8214-419b-930b-30d3f71e407e" returned: 0 in 0.599s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.227s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-219005494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900a7b56-e765-493c-bea8-732fc7062fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f0cb0cb86447d1b247eb28a4f149e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:39Z,use_quota=True,user_id='970f6a1ef4134e0d9fee5a47f907fd7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Creating volume 900a7b56-e765-493c-bea8-732fc7062fdd {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:39 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff04dd6-f57d-4104-aed5-bd0cfda2de87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d0266d8-8214-419b-930b-30d3f71e407e', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e104a8-6f3c-468d-970b-8a0f19691c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:39 devstack sudo[87671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd 1073741824
Apr 27 15:12:39 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:39 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Volume volume-0d0266d8-8214-419b-930b-30d3f71e407e (0d0266d8-8214-419b-930b-30d3f71e407e): created successfully
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e104a8-6f3c-468d-970b-8a0f19691c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Flow 'volume_create_manager' (79f1c3f0-9dec-408e-9c38-2113059cc180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5012e8ea-5780-44f1-9d24-742840e1bc52 tempest-VolumesListAdminTestJSON-2082956035 None] Created volume successfully.
Apr 27 15:12:39 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887" returned: 0 in 0.581s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:39 devstack sudo[87676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887
Apr 27 15:12:39 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:40 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-be0e9687-ebbe-44ed-b575-297e63b6c887" returned: 0 in 0.490s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:40 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd 1073741824" returned: 0 in 0.695s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-be0e9687-ebbe-44ed-b575-297e63b6c887" released by "delete_volume" :: held 1.148s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:40 devstack sudo[87682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd
Apr 27 15:12:40 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Created reservations ['ac3747e2-d25f-4af3-b80a-b94453fec8ae', 'f3ffbd92-da11-4156-b1ec-4ff480bbe638', 'a143bb85-0945-4f3f-a86b-abdb1be7d6ef', '47f0072d-1da8-45f5-b04b-571a5600cdaa'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:40 devstack sudo[87684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:40 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:40 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-10481fdd-b6ab-4f99-a340-6a4461986635 tempest-GroupsTest-1189300331 None] Group tempest-Group2-371634086: creating
Apr 27 15:12:40 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-10481fdd-b6ab-4f99-a340-6a4461986635 tempest-GroupsTest-1189300331 None] Group tempest-Group2-371634086: created successfully
Apr 27 15:12:40 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Flow 'volume_create_manager' (1cc53aa9-fd04-48eb-9f30-ef97a255f6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c482391-ea94-4092-a64a-2fdc624950ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd" returned: 0 in 0.492s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:40 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-10481fdd-b6ab-4f99-a340-6a4461986635 tempest-GroupsTest-1189300331 None] Create group completed successfully.
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c482391-ea94-4092-a64a-2fdc624950ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1313862320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba25048-83d2-492f-bb60-73836f651d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9ffaf858b24dffbcdbd5b90c2a0a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:41Z,use_quota=True,user_id='6c6496266d214a1fbe1977e90c32b329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bfa355-cebc-4aa9-b7d5-2926921fee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bfa355-cebc-4aa9-b7d5-2926921fee14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca439432-1cca-44ac-9862-6bd90e79aacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca439432-1cca-44ac-9862-6bd90e79aacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ba25048-83d2-492f-bb60-73836f651d26', 'volume_name': 'volume-1ba25048-83d2-492f-bb60-73836f651d26', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed19bb9-3759-4fed-b007-41b5c8126046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed19bb9-3759-4fed-b007-41b5c8126046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27e73fc-a12c-4d7d-a308-06c2a09f6a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:40 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Volume 1ba25048-83d2-492f-bb60-73836f651d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ba25048-83d2-492f-bb60-73836f651d26', 'volume_size': 1}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1313862320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba25048-83d2-492f-bb60-73836f651d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d9ffaf858b24dffbcdbd5b90c2a0a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:41Z,use_quota=True,user_id='6c6496266d214a1fbe1977e90c32b329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Creating volume 1ba25048-83d2-492f-bb60-73836f651d26 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:40 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ba25048-83d2-492f-bb60-73836f651d26 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2821efa-47e5-4838-b8b1-a1adfb139e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-900a7b56-e765-493c-bea8-732fc7062fdd', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6067b9-c6ba-4294-a591-df9c8b99e758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:40 devstack sudo[87689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ba25048-83d2-492f-bb60-73836f651d26 1073741824
Apr 27 15:12:40 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:40 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Volume volume-900a7b56-e765-493c-bea8-732fc7062fdd (900a7b56-e765-493c-bea8-732fc7062fdd): created successfully
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6067b9-c6ba-4294-a591-df9c8b99e758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Flow 'volume_create_manager' (f030aa3e-ffd1-4e3a-ab01-21ba02a4c682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:40 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-4e353c2c-ba83-42fb-b81a-4aedbc93156c tempest-CinderUnicodeTest-338666064 None] Created volume successfully.
Apr 27 15:12:40 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.532s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:40 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Deleted volume successfully.
Apr 27 15:12:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-280ae7ab-2fe8-40b7-97c3-b91c8c4c9a1a tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-be0e9687-ebbe-44ed-b575-297e63b6c887-delete_volume" released by "delete_volume" :: held 5.030s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:41 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ba25048-83d2-492f-bb60-73836f651d26 1073741824" returned: 0 in 0.666s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-2c30753c-7fe1-4da4-be96-d575640bd7b1-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ba25048-83d2-492f-bb60-73836f651d26 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:41 devstack sudo[87694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ba25048-83d2-492f-bb60-73836f651d26
Apr 27 15:12:41 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-2c30753c-7fe1-4da4-be96-d575640bd7b1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "cinder-quobyte-2c30753c-7fe1-4da4-be96-d575640bd7b1" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-2c30753c-7fe1-4da4-be96-d575640bd7b1" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7428019-95a3-4376-a2df-6ecc72e7075a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:41 devstack sudo[87696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1
Apr 27 15:12:41 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:41 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ba25048-83d2-492f-bb60-73836f651d26" returned: 0 in 0.499s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.518s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] Creating offline snapshot 55d4ac9f-a14c-46b8-bd07-a52a97423956 of volume 900a7b56-e765-493c-bea8-732fc7062fdd {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27e73fc-a12c-4d7d-a308-06c2a09f6a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba25048-83d2-492f-bb60-73836f651d26', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223c072b-90b8-41f8-a689-eeae6d903d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fe068b-bd3c-492b-8126-e45112bb961a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:41 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Volume volume-1ba25048-83d2-492f-bb60-73836f651d26 (1ba25048-83d2-492f-bb60-73836f651d26): created successfully
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223c072b-90b8-41f8-a689-eeae6d903d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Flow 'volume_create_manager' (1cc53aa9-fd04-48eb-9f30-ef97a255f6e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:41 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Flow 'volume_create_manager' (862c37fb-fc9c-46b5-9e70-0cc59ef4b2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8127da0-0386-43a1-b406-6824ef97a8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:42 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e73c8fc1-e0c1-4e89-b025-81576cec60c9 tempest-VolumesListAdminTestJSON-2082956035 None] Created volume successfully.
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8127da0-0386-43a1-b406-6824ef97a8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1887523605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=772776b4-decd-493c-9801-3df23a428012,host='devstack@QuobyteHD#QuobyteHD',id=89f0ecad-f5e1-446c-8bd2-39e24cc5ab69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4ba01c6ca14d3b8d95951d8849ec12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:42Z,use_quota=True,user_id='57bb5afdd52e40a4872b1b4f4eea1013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a12c6aa3-9677-4615-a332-4a5b54f60049),volume_type_id=a12c6aa3-9677-4615-a332-4a5b54f60049)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:42 devstack sudo[87699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d279c0-17a5-4a04-a804-d0749e08cdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:42 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d279c0-17a5-4a04-a804-d0749e08cdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07008e30-49d5-49ef-b649-ab7478cb968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07008e30-49d5-49ef-b649-ab7478cb968b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f0ecad-f5e1-446c-8bd2-39e24cc5ab69', 'volume_name': 'volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc9d8f8-00e4-41e3-b333-6107affe1d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc9d8f8-00e4-41e3-b333-6107affe1d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b884c28-6bd0-45ec-9e95-af580b56e072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:42 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Volume 89f0ecad-f5e1-446c-8bd2-39e24cc5ab69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69', 'volume_size': 1}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:42 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1" returned: 0 in 0.643s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:42 devstack sudo[87704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1
Apr 27 15:12:42 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:42 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd" returned: 0 in 0.563s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:42 devstack sudo[87710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956 1G
Apr 27 15:12:42 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:42 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2c30753c-7fe1-4da4-be96-d575640bd7b1" returned: 0 in 0.460s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-quobyte-2c30753c-7fe1-4da4-be96-d575640bd7b1" released by "delete_volume" :: held 1.154s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Created reservations ['38c563d8-5ee5-428c-ba77-3d25e643c0f7', '16518115-97bf-480f-b994-ecc2215d46af', 'efee3730-d039-40b4-bb0a-35acfd533cfb', 'f0b20106-0f48-4198-b746-a53cf73152d2'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:42 devstack sudo[87712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:42 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Flow 'volume_create_manager' (ccf3b261-f36a-4438-aaa8-c82f13a16ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9427d2a1-93c7-4dba-a4a5-49d4a15d7da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9427d2a1-93c7-4dba-a4a5-49d4a15d7da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38dd63b2-4715-48e8-a682-ec608db00b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d09c2410f94f3c8da2072d292737a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:43Z,use_quota=True,user_id='cfcc5ecfa37242b4a97619c2df70c144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:43 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:43 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575b9ce4-bd83-46d5-9980-563834960c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (575b9ce4-bd83-46d5-9980-563834960c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff69d7f-4168-4804-abf5-e045183bc58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff69d7f-4168-4804-abf5-e045183bc58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38dd63b2-4715-48e8-a682-ec608db00b77', 'volume_name': 'volume-38dd63b2-4715-48e8-a682-ec608db00b77', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf7c0e8-c20c-4682-ae57-ae7e8ed73da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf7c0e8-c20c-4682-ae57-ae7e8ed73da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d78a73a-0d4e-4556-9e7f-63d506808c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:43 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Volume 38dd63b2-4715-48e8-a682-ec608db00b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38dd63b2-4715-48e8-a682-ec608db00b77', 'volume_size': 1}
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.521s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956 1G" returned: 0 in 0.745s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-900a7b56-e765-493c-bea8-732fc7062fdd -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:43 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Deleted volume successfully.
Apr 27 15:12:43 devstack sudo[87718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-900a7b56-e765-493c-bea8-732fc7062fdd -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956
Apr 27 15:12:43 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7129026c-72e8-41b7-9cae-80570d2f62c6 tempest-VolumesDeleteCascade-591528920 None] Lock "cinder-2c30753c-7fe1-4da4-be96-d575640bd7b1-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:43 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-900a7b56-e765-493c-bea8-732fc7062fdd -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956" returned: 0 in 0.518s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:43 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956 is being set with open permissions: ugo+rw
Apr 27 15:12:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:43 devstack sudo[87723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956
Apr 27 15:12:43 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:44 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956" returned: 0 in 0.502s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:44 devstack sudo[87726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.info
Apr 27 15:12:44 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:44 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.info" returned: 0 in 0.479s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:44 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.info is being set with open permissions: ugo+rw
Apr 27 15:12:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:44 devstack sudo[87729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.info
Apr 27 15:12:44 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:45 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.info" returned: 0 in 0.561s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.494s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.318s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=772776b4-decd-493c-9801-3df23a428012,created_at=2026-04-27T13:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1887523605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=772776b4-decd-493c-9801-3df23a428012,host='devstack@QuobyteHD#QuobyteHD',id=89f0ecad-f5e1-446c-8bd2-39e24cc5ab69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4ba01c6ca14d3b8d95951d8849ec12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:42Z,use_quota=True,user_id='57bb5afdd52e40a4872b1b4f4eea1013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a12c6aa3-9677-4615-a332-4a5b54f60049),volume_type_id=a12c6aa3-9677-4615-a332-4a5b54f60049)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Creating volume 89f0ecad-f5e1-446c-8bd2-39e24cc5ab69 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:45 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:45 devstack sudo[87732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69 1073741824
Apr 27 15:12:45 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:45 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ea9940f8-f193-444a-91a0-cd7f9a317eae tempest-CinderUnicodeTest-338666064 None] Create snapshot completed successfully
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Acquiring lock "cinder-55d4ac9f-a14c-46b8-bd07-a52a97423956-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Lock "cinder-55d4ac9f-a14c-46b8-bd07-a52a97423956-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Acquiring lock "cinder-quobyte-900a7b56-e765-493c-bea8-732fc7062fdd" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Lock "cinder-quobyte-900a7b56-e765-493c-bea8-732fc7062fdd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Acquiring lock "cinder-quobyte-55d4ac9f-a14c-46b8-bd07-a52a97423956" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Lock "cinder-quobyte-55d4ac9f-a14c-46b8-bd07-a52a97423956" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Deleting offline snapshot 55d4ac9f-a14c-46b8-bd07-a52a97423956 of volume 900a7b56-e765-493c-bea8-732fc7062fdd {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] snapshot_file for this snap is: volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84832d9-dace-4c9b-b91c-632108c41b08]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:45 devstack sudo[87734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956
Apr 27 15:12:45 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:46 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Flow 'volume_create_manager' (49f2d8ac-8bc2-4adc-a753-f611574c128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21cac23-7d52-4ed0-99c5-3f629d890d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69 1073741824" returned: 0 in 0.799s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21cac23-7d52-4ed0-99c5-3f629d890d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-164144443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89322072-bab8-41c6-a08c-d8f3c2ecab0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98799af89d74fe9afe91c69ce2adbc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:46Z,use_quota=True,user_id='1457b7dc43b741fd95648c19e3456d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b169af1-4720-4c1e-bd43-ab71fb04e8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b169af1-4720-4c1e-bd43-ab71fb04e8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07e44e5-e2c5-4246-a482-fd1f95f9a399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07e44e5-e2c5-4246-a482-fd1f95f9a399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89322072-bab8-41c6-a08c-d8f3c2ecab0a', 'volume_name': 'volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7aa2ef-f5bb-4538-8f9e-60ca83b392db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7aa2ef-f5bb-4538-8f9e-60ca83b392db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48f5801-2065-4990-870d-fcc258e544ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:46 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Volume 89322072-bab8-41c6-a08c-d8f3c2ecab0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a', 'volume_size': 1}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:46 devstack sudo[87742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69
Apr 27 15:12:46 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:46 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956" returned: 0 in 0.688s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-900a7b56-e765-493c-bea8-732fc7062fdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[817f7a44-6e1d-4886-a025-34b16d8609aa]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:46 devstack sudo[87744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd
Apr 27 15:12:46 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:46 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69" returned: 0 in 0.476s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.516s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38dd63b2-4715-48e8-a682-ec608db00b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d09c2410f94f3c8da2072d292737a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:43Z,use_quota=True,user_id='cfcc5ecfa37242b4a97619c2df70c144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Creating volume 38dd63b2-4715-48e8-a682-ec608db00b77 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:46 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-38dd63b2-4715-48e8-a682-ec608db00b77 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b884c28-6bd0-45ec-9e95-af580b56e072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f4770a-2411-41ad-8cf2-6b87aa165e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:46 devstack sudo[87749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-38dd63b2-4715-48e8-a682-ec608db00b77 1073741824
Apr 27 15:12:46 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:46 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Volume volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69 (89f0ecad-f5e1-446c-8bd2-39e24cc5ab69): created successfully
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f4770a-2411-41ad-8cf2-6b87aa165e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Flow 'volume_create_manager' (862c37fb-fc9c-46b5-9e70-0cc59ef4b2c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:46 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ec250044-dd7e-4ddc-8ba6-395e89d16768 tempest-GroupsTest-1189300331 None] Created volume successfully.
Apr 27 15:12:46 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd" returned: 0 in 0.526s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:46 devstack sudo[87752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956
Apr 27 15:12:46 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:47 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-38dd63b2-4715-48e8-a682-ec608db00b77 1073741824" returned: 0 in 0.726s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:47 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956" returned: 0 in 0.649s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:47 devstack sudo[87762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956
Apr 27 15:12:47 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-38dd63b2-4715-48e8-a682-ec608db00b77 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:47 devstack sudo[87764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-38dd63b2-4715-48e8-a682-ec608db00b77
Apr 27 15:12:47 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Acquiring lock "cinder-quobyte-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Lock "cinder-quobyte-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69" acquired by "delete_volume" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:47 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8a8aa9-19cb-4c5d-9e89-838e091df360]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:47 devstack sudo[87766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69
Apr 27 15:12:47 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:48 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd.55d4ac9f-a14c-46b8-bd07-a52a97423956" returned: 0 in 0.515s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:48 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Lock "cinder-quobyte-55d4ac9f-a14c-46b8-bd07-a52a97423956" released by "_delete_snapshot" :: held 2.492s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-38dd63b2-4715-48e8-a682-ec608db00b77" returned: 0 in 0.544s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Lock "cinder-quobyte-900a7b56-e765-493c-bea8-732fc7062fdd" released by "delete_snapshot" :: held 2.527s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.863s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-164144443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89322072-bab8-41c6-a08c-d8f3c2ecab0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98799af89d74fe9afe91c69ce2adbc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:46Z,use_quota=True,user_id='1457b7dc43b741fd95648c19e3456d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Creating volume 89322072-bab8-41c6-a08c-d8f3c2ecab0a {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:12:48 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:48 devstack sudo[87770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a 1073741824
Apr 27 15:12:48 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d78a73a-0d4e-4556-9e7f-63d506808c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38dd63b2-4715-48e8-a682-ec608db00b77', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a489768-9c0a-4380-85bb-7923ff38925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:48 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Volume volume-38dd63b2-4715-48e8-a682-ec608db00b77 (38dd63b2-4715-48e8-a682-ec608db00b77): created successfully
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a489768-9c0a-4380-85bb-7923ff38925d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Flow 'volume_create_manager' (ccf3b261-f36a-4438-aaa8-c82f13a16ad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:48 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-1194cc4c-c7a1-4fc1-aab4-d60b39b1a550 tempest-VolumesListAdminTestJSON-1950293298 None] Created volume successfully.
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Created reservations ['ceb50861-cb72-4f8c-a0c4-f4c83d07231a', '7047da7f-359d-4b85-9a75-976d9dd05ef5', '0adce4b8-a5b3-4693-96d4-0e75af08a8df', '73d9107f-9439-42d7-8a17-289d83695bf1'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:48 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Delete snapshot completed successfully.
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df5b361b-6c4b-4907-8489-1d492cdecb7a tempest-CinderUnicodeTest-338666064 None] Lock "cinder-55d4ac9f-a14c-46b8-bd07-a52a97423956-delete_snapshot" released by "delete_snapshot" :: held 2.716s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:48 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69" returned: 0 in 0.578s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:48 devstack sudo[87776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69
Apr 27 15:12:48 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Acquiring lock "cinder-38dd63b2-4715-48e8-a682-ec608db00b77-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Lock "cinder-38dd63b2-4715-48e8-a682-ec608db00b77-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Acquiring lock "cinder-quobyte-38dd63b2-4715-48e8-a682-ec608db00b77" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Lock "cinder-quobyte-38dd63b2-4715-48e8-a682-ec608db00b77" acquired by "delete_volume" :: waited 0.027s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Acquiring lock "cinder-900a7b56-e765-493c-bea8-732fc7062fdd-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7501232-a57e-45c9-8f24-b0e8e30ba91d]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-38dd63b2-4715-48e8-a682-ec608db00b77 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Lock "cinder-900a7b56-e765-493c-bea8-732fc7062fdd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "cinder-1ba25048-83d2-492f-bb60-73836f651d26-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Acquiring lock "cinder-quobyte-900a7b56-e765-493c-bea8-732fc7062fdd" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "cinder-1ba25048-83d2-492f-bb60-73836f651d26-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Lock "cinder-quobyte-900a7b56-e765-493c-bea8-732fc7062fdd" acquired by "delete_volume" :: waited 0.028s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:48 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a 1073741824" returned: 0 in 0.859s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:48 devstack sudo[87781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-38dd63b2-4715-48e8-a682-ec608db00b77
Apr 27 15:12:48 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e082c84-1372-4e72-b732-6f7fb8574a8d]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "cinder-quobyte-1ba25048-83d2-492f-bb60-73836f651d26" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "cinder-quobyte-1ba25048-83d2-492f-bb60-73836f651d26" acquired by "delete_volume" :: waited 0.031s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:49 devstack sudo[87785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a
Apr 27 15:12:49 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:49 devstack sudo[87784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd
Apr 27 15:12:49 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa989a04-901d-4da9-84d5-dac3f018ebc0]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ba25048-83d2-492f-bb60-73836f651d26 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:49 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:49 devstack sudo[87788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ba25048-83d2-492f-bb60-73836f651d26
Apr 27 15:12:49 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69" returned: 0 in 0.716s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Lock "cinder-quobyte-89f0ecad-f5e1-446c-8bd2-39e24cc5ab69" released by "delete_volume" :: held 1.333s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Created reservations ['4b21bf45-a675-4781-8157-52d7c3621533'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:49 devstack cinder-volume[81538]: WARNING cinder.quota [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-40607486 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-40607486, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:12:49 devstack cinder-volume[81538]: WARNING cinder.quota [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-40607486 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-40607486, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Created reservations ['e6b5311b-8de3-4761-b26c-a888ebbfc7e2', '24a3ec6a-659c-46c9-9715-b196d115189b', '3dbc023d-5161-4def-884a-293373d679ff', '73764c17-f618-488a-bdbd-1df0b0572419'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:49 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-38dd63b2-4715-48e8-a682-ec608db00b77" returned: 0 in 0.774s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-38dd63b2-4715-48e8-a682-ec608db00b77 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:49 devstack sudo[87794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:49 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:49 devstack sudo[87795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-38dd63b2-4715-48e8-a682-ec608db00b77
Apr 27 15:12:49 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:49 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a" returned: 0 in 0.571s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48f5801-2065-4990-870d-fcc258e544ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e52b771f-4505-47eb-a336-5b9522e4ee6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:49 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Volume volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a (89322072-bab8-41c6-a08c-d8f3c2ecab0a): created successfully
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e52b771f-4505-47eb-a336-5b9522e4ee6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Flow 'volume_create_manager' (49f2d8ac-8bc2-4adc-a753-f611574c128f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:49 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-0e210c73-897d-4520-8e16-b56388879b99 tempest-VolumesCloneTest-1546010268 None] Created volume successfully.
Apr 27 15:12:49 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd" returned: 0 in 0.787s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:49 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ba25048-83d2-492f-bb60-73836f651d26" returned: 0 in 0.705s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ba25048-83d2-492f-bb60-73836f651d26 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:49 devstack sudo[87804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd
Apr 27 15:12:49 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:49 devstack sudo[87805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ba25048-83d2-492f-bb60-73836f651d26
Apr 27 15:12:49 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:50 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-38dd63b2-4715-48e8-a682-ec608db00b77" returned: 0 in 0.555s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Lock "cinder-quobyte-38dd63b2-4715-48e8-a682-ec608db00b77" released by "delete_volume" :: held 1.395s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:50 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.641s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:50 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-7331b9d8-34f4-4d55-bc1c-b2f5237d89db tempest-GroupsTest-1189300331 None] Delete group completed successfully.
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Created reservations ['630c16a6-1419-40e9-b89c-0e6c897729fb', 'e20c6e72-08b8-40bd-a391-1909ba106f2a', 'c2eaadf6-ad72-4459-a5cd-2719c044f2fb', '6cc249c8-0a9c-4268-878d-6a291b2d77fc'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-64396a3b-837e-405a-83ad-26082dfae26a tempest-GroupsTest-1189300331 None] Created reservations ['6595dd2a-3212-4a90-a470-003610668bb9'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:50 devstack sudo[87812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:50 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:50 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-900a7b56-e765-493c-bea8-732fc7062fdd" returned: 0 in 0.623s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-64396a3b-837e-405a-83ad-26082dfae26a tempest-GroupsTest-1189300331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-64396a3b-837e-405a-83ad-26082dfae26a tempest-GroupsTest-1189300331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-64396a3b-837e-405a-83ad-26082dfae26a tempest-GroupsTest-1189300331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-64396a3b-837e-405a-83ad-26082dfae26a tempest-GroupsTest-1189300331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-64396a3b-837e-405a-83ad-26082dfae26a tempest-GroupsTest-1189300331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-64396a3b-837e-405a-83ad-26082dfae26a tempest-GroupsTest-1189300331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Lock "cinder-quobyte-900a7b56-e765-493c-bea8-732fc7062fdd" released by "delete_volume" :: held 1.544s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:50 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-1ba25048-83d2-492f-bb60-73836f651d26" returned: 0 in 0.659s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:50 devstack sudo[87814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:50 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "cinder-quobyte-1ba25048-83d2-492f-bb60-73836f651d26" released by "delete_volume" :: held 1.433s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Created reservations ['da9668b7-023f-448d-a82b-251ec38f36c7', '9995be63-7d64-4ad7-a0bc-f6ee2ac1cf9c', 'e67b01b9-0ffc-45c9-919d-5a7d2c7e0ade', '34b797d1-7d2a-4dfa-b32d-811765af4a64'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Created reservations ['1e24ea50-df4a-4892-8ed3-fc3aa69406d3', '5080cc10-0eeb-4e65-bad0-f6d98d3cd29d', '7d5135d8-af89-41e9-996a-962a42c0b628', 'db2f5163-bd7b-45ac-a68a-39bebd8cbe9d'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:50 devstack sudo[87816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:50 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:50 devstack sudo[87818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:50 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:50 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:51 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.654s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Flow 'volume_create_manager' (bc586169-cc8a-4726-8f5b-6d3cd66a769a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf7dd41-5ab8-4338-8e3f-b3d14b746a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:51 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Deleted volume successfully.
Apr 27 15:12:51 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Acquiring lock "cinder-5ff3b039-59db-48d4-a82d-955ef38397ef-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf7dd41-5ab8-4338-8e3f-b3d14b746a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-823515768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548b1028-6d25-4acf-b22a-c5a073f780bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98799af89d74fe9afe91c69ce2adbc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=89322072-bab8-41c6-a08c-d8f3c2ecab0a,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:51Z,use_quota=True,user_id='1457b7dc43b741fd95648c19e3456d7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b57f21e-6692-4184-b1da-f30ecafae907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b57f21e-6692-4184-b1da-f30ecafae907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22384007-cb05-452c-90e2-5bcfc3de4dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-64396a3b-837e-405a-83ad-26082dfae26a tempest-GroupsTest-1189300331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.705s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-64396a3b-837e-405a-83ad-26082dfae26a tempest-GroupsTest-1189300331 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:51 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-64396a3b-837e-405a-83ad-26082dfae26a tempest-GroupsTest-1189300331 None] Delete group completed successfully.
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22384007-cb05-452c-90e2-5bcfc3de4dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '548b1028-6d25-4acf-b22a-c5a073f780bc', 'volume_name': 'volume-548b1028-6d25-4acf-b22a-c5a073f780bc', 'volume_size': 2, 'source_volid': '89322072-bab8-41c6-a08c-d8f3c2ecab0a', 'source_volstatus': 'available'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73894cd3-b289-4187-94c4-efbc6b388ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73894cd3-b289-4187-94c4-efbc6b388ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39224f6c-b9f7-4c28-ac43-7831bb1af03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:51 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Volume 548b1028-6d25-4acf-b22a-c5a073f780bc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-548b1028-6d25-4acf-b22a-c5a073f780bc', 'volume_size': 2, 'source_volid': '89322072-bab8-41c6-a08c-d8f3c2ecab0a', 'source_volstatus': 'available'}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-10e617ce-637f-40f2-82d4-db4ad057712c tempest-VolumesListAdminTestJSON-1950293298 None] Lock "cinder-38dd63b2-4715-48e8-a682-ec608db00b77-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Lock "cinder-5ff3b039-59db-48d4-a82d-955ef38397ef-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:51 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Cloning volume 89322072-bab8-41c6-a08c-d8f3c2ecab0a to volume 548b1028-6d25-4acf-b22a-c5a073f780bc
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "cinder-0d0266d8-8214-419b-930b-30d3f71e407e-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Creating offline snapshot 1b479c44-b1fd-44ae-8082-6251df59460a of volume 89322072-bab8-41c6-a08c-d8f3c2ecab0a {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Acquiring lock "cinder-quobyte-5ff3b039-59db-48d4-a82d-955ef38397ef" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4540b712-cc44-40a9-a375-aa374ff7bf73]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "cinder-0d0266d8-8214-419b-930b-30d3f71e407e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:51 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Lock "cinder-quobyte-5ff3b039-59db-48d4-a82d-955ef38397ef" acquired by "delete_volume" :: waited 0.051s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.729s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:51 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Deleted volume successfully.
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2684f90f-d327-4730-9c6c-77a9822ee677]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5ff3b039-59db-48d4-a82d-955ef38397ef {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "cinder-quobyte-0d0266d8-8214-419b-930b-30d3f71e407e" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3e01beb0-7768-48f5-8b5f-0a7da3faf42d tempest-CinderUnicodeTest-338666064 None] Lock "cinder-900a7b56-e765-493c-bea8-732fc7062fdd-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "cinder-quobyte-0d0266d8-8214-419b-930b-30d3f71e407e" acquired by "delete_volume" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:51 devstack sudo[87823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a
Apr 27 15:12:51 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d30837-ab72-4135-b610-3a7b6bda16ce]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0d0266d8-8214-419b-930b-30d3f71e407e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:51 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.855s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:51 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Deleted volume successfully.
Apr 27 15:12:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-31cca0ec-b305-4369-b728-30d77e155345 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "cinder-1ba25048-83d2-492f-bb60-73836f651d26-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:51 devstack sudo[87825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5ff3b039-59db-48d4-a82d-955ef38397ef
Apr 27 15:12:51 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:51 devstack sudo[87827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0d0266d8-8214-419b-930b-30d3f71e407e
Apr 27 15:12:51 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:51 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-d6426b36-1eda-444c-ae06-62b129af8a9d tempest-GroupsTest-1189300331 None] Group tempest-GroupsTest-Group-1574672377: creating
Apr 27 15:12:52 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-d6426b36-1eda-444c-ae06-62b129af8a9d tempest-GroupsTest-1189300331 None] Group tempest-GroupsTest-Group-1574672377: created successfully
Apr 27 15:12:52 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-d6426b36-1eda-444c-ae06-62b129af8a9d tempest-GroupsTest-1189300331 None] Create group completed successfully.
Apr 27 15:12:52 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a" returned: 0 in 0.774s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:52 devstack sudo[87839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a 1G
Apr 27 15:12:52 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:52 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5ff3b039-59db-48d4-a82d-955ef38397ef" returned: 0 in 0.752s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5ff3b039-59db-48d4-a82d-955ef38397ef {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:52 devstack sudo[87841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5ff3b039-59db-48d4-a82d-955ef38397ef
Apr 27 15:12:52 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:52 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0d0266d8-8214-419b-930b-30d3f71e407e" returned: 0 in 0.653s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0d0266d8-8214-419b-930b-30d3f71e407e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:52 devstack sudo[87843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0d0266d8-8214-419b-930b-30d3f71e407e
Apr 27 15:12:52 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:52 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5ff3b039-59db-48d4-a82d-955ef38397ef" returned: 0 in 0.470s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Lock "cinder-quobyte-5ff3b039-59db-48d4-a82d-955ef38397ef" released by "delete_volume" :: held 1.270s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Created reservations ['0ca3de8d-b0b8-4d23-aee9-a2f70daac07b', 'fb03b4c4-f87c-4cc0-b5a9-7ae55f9f5a69', '3ea030a5-29b3-40fc-b550-4831bd46abc0', '451301da-f24c-4f45-992e-e6259666f7ed'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:52 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0d0266d8-8214-419b-930b-30d3f71e407e" returned: 0 in 0.522s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "cinder-quobyte-0d0266d8-8214-419b-930b-30d3f71e407e" released by "delete_volume" :: held 1.233s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:52 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a 1G" returned: 0 in 0.648s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:52 devstack sudo[87850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:52 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:52 devstack sudo[87851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a
Apr 27 15:12:52 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Created reservations ['30d362b1-c7b8-4670-b91a-ad3df1af4397', 'd45b467d-1a0a-4094-a40d-c5cc160bab3b', 'd1d96286-0040-4671-a1ac-3bdb5f2a7ed9', '17d8d50f-8f97-4d27-8f8f-470732fe4b3c'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:52 devstack sudo[87854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:52 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:53 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.537s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:53 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Deleted volume successfully.
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e459a3a0-390f-412f-b186-e18065c21aad tempest-CinderUnicodeTest-338666064 None] Lock "cinder-5ff3b039-59db-48d4-a82d-955ef38397ef-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:53 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a" returned: 0 in 0.596s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:53 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a is being set with open permissions: ugo+rw
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:53 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.527s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:53 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Deleted volume successfully.
Apr 27 15:12:53 devstack sudo[87861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a
Apr 27 15:12:53 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f2bed36e-5e40-4f2d-aa37-c323dddf9af0 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "cinder-0d0266d8-8214-419b-930b-30d3f71e407e-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Flow 'volume_create_manager' (9d076182-2fab-4308-8f86-c9ed0eaf4c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7e28f6-cdd7-4c7d-8039-16d9c29bc085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7e28f6-cdd7-4c7d-8039-16d9c29bc085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-877964643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=76ae7643-b32b-4203-a4c2-b9cb628ef767,host='devstack@QuobyteHD#QuobyteHD',id=8407eddd-578f-4cd9-ae6e-5fa5138f652d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4ba01c6ca14d3b8d95951d8849ec12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:53Z,use_quota=True,user_id='57bb5afdd52e40a4872b1b4f4eea1013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a74f3808-6ca8-4ae6-a624-0a7369a9e584),volume_type_id=a74f3808-6ca8-4ae6-a624-0a7369a9e584)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfe53f9-16be-4a3d-9138-4c77383e3668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfe53f9-16be-4a3d-9138-4c77383e3668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24ba69d-bc7b-46ba-8bd8-e54bbecfb828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24ba69d-bc7b-46ba-8bd8-e54bbecfb828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8407eddd-578f-4cd9-ae6e-5fa5138f652d', 'volume_name': 'volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2e6459-aa71-4f90-9d69-0aee89fa4613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2e6459-aa71-4f90-9d69-0aee89fa4613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb9a497-9256-4090-846c-f30d4400473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:12:53 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Volume 8407eddd-578f-4cd9-ae6e-5fa5138f652d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d', 'volume_size': 1}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "cinder-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "cinder-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "cinder-quobyte-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "cinder-quobyte-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a04aaa-0498-4d01-8981-ce3bbfdf4eb9]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:53 devstack sudo[87863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b
Apr 27 15:12:53 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:53 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a" returned: 0 in 0.595s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:54 devstack sudo[87866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.info
Apr 27 15:12:54 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:54 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b" returned: 0 in 0.610s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:54 devstack sudo[87871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b
Apr 27 15:12:54 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:54 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.info" returned: 0 in 0.642s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:54 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.info is being set with open permissions: ugo+rw
Apr 27 15:12:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:54 devstack sudo[87874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.info
Apr 27 15:12:54 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:54 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b" returned: 0 in 0.501s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "cinder-quobyte-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b" released by "delete_volume" :: held 1.152s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:54 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Created reservations ['d965ba0c-99ff-4479-a18d-94f2642272b7', '9d138cb6-1889-4a26-a12e-b4cc1d071560', 'a2a7a56f-c8c5-45d3-bf82-5d154cf6a9d9', 'ec90df08-3331-4aa8-ac7e-109633e380c6'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:12:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:55 devstack sudo[87877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:12:55 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:55 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.info" returned: 0 in 0.544s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Acquiring lock "cinder-quobyte-548b1028-6d25-4acf-b22a-c5a073f780bc" by "_copy_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Lock "cinder-quobyte-548b1028-6d25-4acf-b22a-c5a073f780bc" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] snapshot: 1b479c44-b1fd-44ae-8082-6251df59460a, volume: 548b1028-6d25-4acf-b22a-c5a073f780bc,  {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15fbc70-d8bd-4b22-b3aa-26914cd6a23c]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:55 devstack sudo[87880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a
Apr 27 15:12:55 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:55 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.526s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:12:55 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Deleted volume successfully.
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2d1d5128-ee0e-465c-b22a-0cff99729282 tempest-VolumesListAdminTestJSON-2082956035 None] Lock "cinder-a25a0d98-1b8c-4e4d-8fa5-a54a0b3dd67b-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:12:55 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a" returned: 0 in 0.645s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Creating direct copy from snapshot {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c0ec49-afdc-4239-b185-84ac5a5d4015]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:12:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:56 devstack sudo[87886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a
Apr 27 15:12:56 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:12:56 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root
Apr 27 15:12:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a" returned: 0 in 0.643s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:12:56 devstack cinder-volume[81538]: DEBUG cinder.utils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Path /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc not found in is_blk_device check {{(pid=81538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 27 15:12:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:12:56 devstack sudo[87891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc
Apr 27 15:12:56 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:02 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc" returned: 0 in 6.429s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:03 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbb724c-bcd2-4dec-921b-04bb3f1421e5]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:03 devstack sudo[87942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a
Apr 27 15:13:03 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:03 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a" returned: 0 in 0.810s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:03 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:13:03 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Converted 1024.00 MB image at 159.24 MB/s
Apr 27 15:13:03 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc is being set with open permissions: ugo+rw
Apr 27 15:13:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:03 devstack sudo[87947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc
Apr 27 15:13:03 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:04 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc" returned: 0 in 0.604s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Lock "cinder-quobyte-548b1028-6d25-4acf-b22a-c5a073f780bc" released by "_copy_volume_from_snapshot" :: held 9.230s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:04 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:UPDATE=253,cinder:SELECT=178,cinder:DELETE=22,cinder:INSERT=56 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:13:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Acquiring lock "cinder-quobyte-1b479c44-b1fd-44ae-8082-6251df59460a" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Lock "cinder-quobyte-1b479c44-b1fd-44ae-8082-6251df59460a" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Deleting offline snapshot 1b479c44-b1fd-44ae-8082-6251df59460a of volume 89322072-bab8-41c6-a08c-d8f3c2ecab0a {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:13:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] snapshot_file for this snap is: volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:13:04 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5425c2-aeee-4653-8762-321be2498cd7]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:04 devstack sudo[87950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a
Apr 27 15:13:04 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:05 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a" returned: 0 in 0.712s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:05 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:13:05 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54c5fec-6fcb-4467-82f3-93b71c10e610]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:05 devstack sudo[87955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a
Apr 27 15:13:05 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:05 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=195,cinder:INSERT=64,cinder:UPDATE=248,cinder:DELETE=19 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:13:06 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a" returned: 0 in 0.714s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:06 devstack sudo[87960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a
Apr 27 15:13:06 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:06 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a" returned: 0 in 0.783s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:06 devstack sudo[87965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a
Apr 27 15:13:06 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:07 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a.1b479c44-b1fd-44ae-8082-6251df59460a" returned: 0 in 0.484s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Lock "cinder-quobyte-1b479c44-b1fd-44ae-8082-6251df59460a" released by "_delete_snapshot" :: held 2.799s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.121s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.794s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=76ae7643-b32b-4203-a4c2-b9cb628ef767,created_at=2026-04-27T13:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-877964643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=76ae7643-b32b-4203-a4c2-b9cb628ef767,host='devstack@QuobyteHD#QuobyteHD',id=8407eddd-578f-4cd9-ae6e-5fa5138f652d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4ba01c6ca14d3b8d95951d8849ec12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:12:53Z,use_quota=True,user_id='57bb5afdd52e40a4872b1b4f4eea1013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a74f3808-6ca8-4ae6-a624-0a7369a9e584),volume_type_id=a74f3808-6ca8-4ae6-a624-0a7369a9e584)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Creating volume 8407eddd-578f-4cd9-ae6e-5fa5138f652d {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:13:07 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39224f6c-b9f7-4c28-ac43-7831bb1af03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-548b1028-6d25-4acf-b22a-c5a073f780bc', 'volume_size': 2, 'source_volid': '89322072-bab8-41c6-a08c-d8f3c2ecab0a', 'source_volstatus': 'available'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0cc021-6401-4315-9000-b96a4d5d428e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:07 devstack sudo[87968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d 1073741824
Apr 27 15:13:07 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:07 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Volume volume-548b1028-6d25-4acf-b22a-c5a073f780bc (548b1028-6d25-4acf-b22a-c5a073f780bc): created successfully
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0cc021-6401-4315-9000-b96a4d5d428e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Flow 'volume_create_manager' (bc586169-cc8a-4726-8f5b-6d3cd66a769a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:07 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-6d95d52e-7cc3-41d4-9f49-f598ffee8270 tempest-VolumesCloneTest-1546010268 None] Created volume successfully.
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Acquiring lock "cinder-548b1028-6d25-4acf-b22a-c5a073f780bc-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Lock "cinder-548b1028-6d25-4acf-b22a-c5a073f780bc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Acquiring lock "cinder-quobyte-548b1028-6d25-4acf-b22a-c5a073f780bc" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Lock "cinder-quobyte-548b1028-6d25-4acf-b22a-c5a073f780bc" acquired by "delete_volume" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5a677e-8b88-4494-8114-f87bae1c9ca8]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:08 devstack sudo[87972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc
Apr 27 15:13:08 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Flow 'volume_create_manager' (c3b36867-9ca6-4fd3-9ab9-dbb072c9da8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130c0020-0a26-4069-8fef-06dbc58952f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130c0020-0a26-4069-8fef-06dbc58952f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-806319478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ac4466-bfae-486f-9d8a-0043b5d3e0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2bd114c5b59461dabcdf080b89700d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:08Z,use_quota=True,user_id='782aa4930d3a40c0a23f3e7054a47892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec7be36-1dc8-4909-bb17-331c2589fa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec7be36-1dc8-4909-bb17-331c2589fa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73741cc-f3e2-4827-b470-d2b498c5f73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73741cc-f3e2-4827-b470-d2b498c5f73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8ac4466-bfae-486f-9d8a-0043b5d3e0c0', 'volume_name': 'volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25495c9-55e7-4776-bc70-7ffe29d49cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25495c9-55e7-4776-bc70-7ffe29d49cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5818c226-aeb1-4c36-a809-194f856eac34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:08 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Volume f8ac4466-bfae-486f-9d8a-0043b5d3e0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0', 'volume_size': 1}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:08 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d 1073741824" returned: 0 in 0.909s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:08 devstack sudo[87976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d
Apr 27 15:13:08 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:08 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc" returned: 0 in 0.703s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:08 devstack sudo[87981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc
Apr 27 15:13:08 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:08 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d" returned: 0 in 0.614s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-806319478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ac4466-bfae-486f-9d8a-0043b5d3e0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2bd114c5b59461dabcdf080b89700d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:08Z,use_quota=True,user_id='782aa4930d3a40c0a23f3e7054a47892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Creating volume f8ac4466-bfae-486f-9d8a-0043b5d3e0c0 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:13:09 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb9a497-9256-4090-846c-f30d4400473b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:09 devstack sudo[87984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0 1073741824
Apr 27 15:13:09 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f89de5-8ea0-4199-a2af-024f0d52aba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:09 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Volume volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d (8407eddd-578f-4cd9-ae6e-5fa5138f652d): created successfully
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f89de5-8ea0-4199-a2af-024f0d52aba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Flow 'volume_create_manager' (9d076182-2fab-4308-8f86-c9ed0eaf4c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:09 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5568f504-57db-4ae3-ac06-386642053e82 tempest-GroupsTest-1189300331 None] Created volume successfully.
Apr 27 15:13:09 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-548b1028-6d25-4acf-b22a-c5a073f780bc" returned: 0 in 0.553s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Lock "cinder-quobyte-548b1028-6d25-4acf-b22a-c5a073f780bc" released by "delete_volume" :: held 1.322s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Created reservations ['9b5c95d8-ed8e-48fb-9367-c2a6cee2abbd', 'ade888c5-acaf-4ec0-945a-c0cb599a9a86', '4a541145-c0f0-478a-b2f7-de8f81a8a266', '351afcf1-901e-4c6e-aa2c-e22dc5fee2b5'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:09 devstack sudo[87989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:13:09 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:09 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0 1073741824" returned: 0 in 0.726s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:09 devstack sudo[87992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0
Apr 27 15:13:09 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:10 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.643s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:13:10 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Deleted volume successfully.
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f2168f37-19e2-4f34-a8eb-f29ed30e26aa tempest-VolumesCloneTest-1546010268 None] Lock "cinder-548b1028-6d25-4acf-b22a-c5a073f780bc-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Flow 'volume_create_manager' (40e3db76-45d4-48af-84d8-0c4a6cbf86f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32a695d-8860-40ea-92bd-c4cd39d1e47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32a695d-8860-40ea-92bd-c4cd39d1e47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-169264188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=76ae7643-b32b-4203-a4c2-b9cb628ef767,host='devstack@QuobyteHD#QuobyteHD',id=52bdcca4-47c3-4eb6-9c06-ade329f63467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4ba01c6ca14d3b8d95951d8849ec12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:10Z,use_quota=True,user_id='57bb5afdd52e40a4872b1b4f4eea1013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a74f3808-6ca8-4ae6-a624-0a7369a9e584),volume_type_id=a74f3808-6ca8-4ae6-a624-0a7369a9e584)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f958ba8b-6690-470d-a70d-e812f2fc4605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f958ba8b-6690-470d-a70d-e812f2fc4605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8d466d-e605-4a25-8ccb-7815d9177982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8d466d-e605-4a25-8ccb-7815d9177982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52bdcca4-47c3-4eb6-9c06-ade329f63467', 'volume_name': 'volume-52bdcca4-47c3-4eb6-9c06-ade329f63467', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13381686-a3b6-486e-a6bf-f48929202c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13381686-a3b6-486e-a6bf-f48929202c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92151da3-d0e9-4488-adfa-56ff9229c489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:10 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Volume 52bdcca4-47c3-4eb6-9c06-ade329f63467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52bdcca4-47c3-4eb6-9c06-ade329f63467', 'volume_size': 1}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Acquiring lock "cinder-89322072-bab8-41c6-a08c-d8f3c2ecab0a-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Lock "cinder-89322072-bab8-41c6-a08c-d8f3c2ecab0a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Acquiring lock "cinder-quobyte-89322072-bab8-41c6-a08c-d8f3c2ecab0a" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Lock "cinder-quobyte-89322072-bab8-41c6-a08c-d8f3c2ecab0a" acquired by "delete_volume" :: waited 0.014s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec4148a-beae-47bf-9bf8-1f9d44d4eae6]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:10 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0" returned: 0 in 0.638s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.136s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=76ae7643-b32b-4203-a4c2-b9cb628ef767,created_at=2026-04-27T13:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-169264188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=76ae7643-b32b-4203-a4c2-b9cb628ef767,host='devstack@QuobyteHD#QuobyteHD',id=52bdcca4-47c3-4eb6-9c06-ade329f63467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4ba01c6ca14d3b8d95951d8849ec12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:10Z,use_quota=True,user_id='57bb5afdd52e40a4872b1b4f4eea1013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a74f3808-6ca8-4ae6-a624-0a7369a9e584),volume_type_id=a74f3808-6ca8-4ae6-a624-0a7369a9e584)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Creating volume 52bdcca4-47c3-4eb6-9c06-ade329f63467 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:13:10 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52bdcca4-47c3-4eb6-9c06-ade329f63467 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5818c226-aeb1-4c36-a809-194f856eac34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:10 devstack sudo[87997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52bdcca4-47c3-4eb6-9c06-ade329f63467 1073741824
Apr 27 15:13:10 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577fff18-ad3c-4e66-9cc4-407dad075381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:10 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Volume volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0 (f8ac4466-bfae-486f-9d8a-0043b5d3e0c0): created successfully
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577fff18-ad3c-4e66-9cc4-407dad075381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Flow 'volume_create_manager' (c3b36867-9ca6-4fd3-9ab9-dbb072c9da8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:10 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-7518a192-b230-4b56-880a-91a032223bd2 tempest-VolumesTransfersV357Test-1388401655 None] Created volume successfully.
Apr 27 15:13:10 devstack sudo[87996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a
Apr 27 15:13:10 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:11 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a" returned: 0 in 0.609s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:11 devstack sudo[88006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a
Apr 27 15:13:11 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:11 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52bdcca4-47c3-4eb6-9c06-ade329f63467 1073741824" returned: 0 in 0.719s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52bdcca4-47c3-4eb6-9c06-ade329f63467 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:11 devstack sudo[88008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52bdcca4-47c3-4eb6-9c06-ade329f63467
Apr 27 15:13:11 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:11 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-89322072-bab8-41c6-a08c-d8f3c2ecab0a" returned: 0 in 0.513s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Lock "cinder-quobyte-89322072-bab8-41c6-a08c-d8f3c2ecab0a" released by "delete_volume" :: held 1.200s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Created reservations ['51daada0-a226-457d-b554-f49e02989d7a', 'eff3da4d-8922-4e7d-afb0-4f77af92e24f', '46aefd9a-cb53-45fd-81dd-65805c1bcdcc', '956b9380-d738-4896-85bd-1ded3356ada0'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:11 devstack sudo[88011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:13:11 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:11 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52bdcca4-47c3-4eb6-9c06-ade329f63467" returned: 0 in 0.649s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92151da3-d0e9-4488-adfa-56ff9229c489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52bdcca4-47c3-4eb6-9c06-ade329f63467', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ba7f01-ece0-4a30-9054-25b8a7d00404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:11 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Volume volume-52bdcca4-47c3-4eb6-9c06-ade329f63467 (52bdcca4-47c3-4eb6-9c06-ade329f63467): created successfully
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ba7f01-ece0-4a30-9054-25b8a7d00404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Flow 'volume_create_manager' (40e3db76-45d4-48af-84d8-0c4a6cbf86f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:11 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-517cadf2-fb5c-4d0b-85cf-a7472afe6e37 tempest-GroupsTest-1189300331 None] Created volume successfully.
Apr 27 15:13:12 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-87b415c8-4d15-4e72-92a9-a1609a14c638 tempest-VolumesTransfersV357Test-1396346523 None] Transfer volume completed successfully.
Apr 27 15:13:12 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.565s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:12 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:13:12 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Deleted volume successfully.
Apr 27 15:13:12 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d655aed2-1414-4234-9891-1602ac6f30b9 tempest-VolumesCloneTest-1546010268 None] Lock "cinder-89322072-bab8-41c6-a08c-d8f3c2ecab0a-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:12 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-8abcff2a-0558-4798-8ee6-0032a948b6d5 tempest-GroupsTest-1189300331 None] Update group completed successfully.
Apr 27 15:13:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Acquiring lock "cinder-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Lock "cinder-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Acquiring lock "cinder-quobyte-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Lock "cinder-quobyte-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0" acquired by "delete_volume" :: waited 0.029s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:13 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a094fcd-e178-4f61-82af-b82c18b6bd0e]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:13 devstack sudo[88015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0
Apr 27 15:13:13 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-10037425-a105-4f7e-b6e9-89eb5e308f94 tempest-GroupsTest-1189300331 None] Update group completed successfully.
Apr 27 15:13:13 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:14 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0" returned: 0 in 0.736s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:14 devstack sudo[88020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0
Apr 27 15:13:14 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:14 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0" returned: 0 in 0.526s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Lock "cinder-quobyte-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0" released by "delete_volume" :: held 1.315s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Created reservations ['f5cac6f0-4c74-4301-b204-4e827d5e822f', 'a8e221d5-a92f-41b5-a74b-a301cc610e57', '53e14db1-8f33-4420-be12-ddadcea23e2c', 'cde6e0ed-ce4f-4e18-ba69-eaf0d3ad9884'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:15 devstack sudo[88023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:13:15 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Acquiring lock "cinder-quobyte-52bdcca4-47c3-4eb6-9c06-ade329f63467" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Lock "cinder-quobyte-52bdcca4-47c3-4eb6-9c06-ade329f63467" acquired by "delete_volume" :: waited 0.042s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d3b765-068d-42c6-a328-19c454ada713]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52bdcca4-47c3-4eb6-9c06-ade329f63467 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:15 devstack sudo[88025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52bdcca4-47c3-4eb6-9c06-ade329f63467
Apr 27 15:13:15 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:15 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.668s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:13:15 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Deleted volume successfully.
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0d70da7b-7dec-4aae-93db-92bf34d68783 tempest-VolumesTransfersV357Test-1354160268 None] Lock "cinder-f8ac4466-bfae-486f-9d8a-0043b5d3e0c0-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:15 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Flow 'volume_create_manager' (2a6f8046-4935-44b3-89d3-213cd82a4fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372e2d26-8055-4bb0-89b5-77b623a922e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372e2d26-8055-4bb0-89b5-77b623a922e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-842564994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d57093-426c-4d06-96cb-325597942775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f2cadf204f4bd092c038ab6dbb8162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:16Z,use_quota=True,user_id='dcbf9e312c1b4cb99a9b0f61f11822f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf8a308-3a23-4d81-ab00-218a986e42f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf8a308-3a23-4d81-ab00-218a986e42f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5645de74-2e48-4c48-a377-d75070dbd0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5645de74-2e48-4c48-a377-d75070dbd0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74d57093-426c-4d06-96cb-325597942775', 'volume_name': 'volume-74d57093-426c-4d06-96cb-325597942775', 'volume_size': 2}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54a68c4-ee63-42e9-9139-ed17afdbf297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54a68c4-ee63-42e9-9139-ed17afdbf297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57048b91-3f9a-4040-a8d5-2f1da99ad770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:16 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Volume 74d57093-426c-4d06-96cb-325597942775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74d57093-426c-4d06-96cb-325597942775', 'volume_size': 2}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-842564994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d57093-426c-4d06-96cb-325597942775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f2cadf204f4bd092c038ab6dbb8162',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:16Z,use_quota=True,user_id='dcbf9e312c1b4cb99a9b0f61f11822f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Creating volume 74d57093-426c-4d06-96cb-325597942775 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:13:16 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-74d57093-426c-4d06-96cb-325597942775 2147483648 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:16 devstack sudo[88028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-74d57093-426c-4d06-96cb-325597942775 2147483648
Apr 27 15:13:16 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Flow 'volume_create_manager' (1ec4cb85-60b7-4942-8e1c-ca822034c217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b419c308-e8ae-4d2e-b659-ed3dbf4ab359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b419c308-e8ae-4d2e-b659-ed3dbf4ab359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1924336137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f8990d-800b-44fc-bd79-51c84337a1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2bd114c5b59461dabcdf080b89700d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:16Z,use_quota=True,user_id='782aa4930d3a40c0a23f3e7054a47892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513d8220-2d05-4f64-9882-4ac4a6dd7543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513d8220-2d05-4f64-9882-4ac4a6dd7543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b729626-505e-4d08-a841-319679729803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b729626-505e-4d08-a841-319679729803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f8990d-800b-44fc-bd79-51c84337a1d6', 'volume_name': 'volume-25f8990d-800b-44fc-bd79-51c84337a1d6', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e01f421-c2ab-4f39-b940-cf520ee6aeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e01f421-c2ab-4f39-b940-cf520ee6aeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d276d8f6-4a16-4355-963c-2d8ef62d8661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:16 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Volume 25f8990d-800b-44fc-bd79-51c84337a1d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f8990d-800b-44fc-bd79-51c84337a1d6', 'volume_size': 1}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:16 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52bdcca4-47c3-4eb6-9c06-ade329f63467" returned: 0 in 0.921s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52bdcca4-47c3-4eb6-9c06-ade329f63467 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:16 devstack sudo[88033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52bdcca4-47c3-4eb6-9c06-ade329f63467
Apr 27 15:13:16 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:17 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-74d57093-426c-4d06-96cb-325597942775 2147483648" returned: 0 in 0.881s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:17 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-74d57093-426c-4d06-96cb-325597942775 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52bdcca4-47c3-4eb6-9c06-ade329f63467" returned: 0 in 0.644s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Lock "cinder-quobyte-52bdcca4-47c3-4eb6-9c06-ade329f63467" released by "delete_volume" :: held 1.619s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:17 devstack sudo[88039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-74d57093-426c-4d06-96cb-325597942775
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Acquiring lock "cinder-quobyte-8407eddd-578f-4cd9-ae6e-5fa5138f652d" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:17 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Lock "cinder-quobyte-8407eddd-578f-4cd9-ae6e-5fa5138f652d" acquired by "delete_volume" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb09c3d9-a683-4cf0-9f0e-1bfabb858564]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:17 devstack sudo[88041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d
Apr 27 15:13:17 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:17 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-74d57093-426c-4d06-96cb-325597942775" returned: 0 in 0.479s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1924336137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f8990d-800b-44fc-bd79-51c84337a1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2bd114c5b59461dabcdf080b89700d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:16Z,use_quota=True,user_id='782aa4930d3a40c0a23f3e7054a47892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Creating volume 25f8990d-800b-44fc-bd79-51c84337a1d6 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:13:17 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-25f8990d-800b-44fc-bd79-51c84337a1d6 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57048b91-3f9a-4040-a8d5-2f1da99ad770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74d57093-426c-4d06-96cb-325597942775', 'volume_size': 2}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee83b686-b6b2-427d-8fce-ea14d8958832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:17 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Volume volume-74d57093-426c-4d06-96cb-325597942775 (74d57093-426c-4d06-96cb-325597942775): created successfully
Apr 27 15:13:17 devstack sudo[88046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-25f8990d-800b-44fc-bd79-51c84337a1d6 1073741824
Apr 27 15:13:17 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee83b686-b6b2-427d-8fce-ea14d8958832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Flow 'volume_create_manager' (2a6f8046-4935-44b3-89d3-213cd82a4fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:17 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-06d4d126-2863-4f64-845d-0a214fd63d2b tempest-VolumesCloneNegativeTest-223470494 None] Created volume successfully.
Apr 27 15:13:17 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d" returned: 0 in 0.562s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:17 devstack sudo[88049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d
Apr 27 15:13:17 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:18 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-8407eddd-578f-4cd9-ae6e-5fa5138f652d" returned: 0 in 0.561s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Lock "cinder-quobyte-8407eddd-578f-4cd9-ae6e-5fa5138f652d" released by "delete_volume" :: held 1.170s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Acquiring lock "cinder-74d57093-426c-4d06-96cb-325597942775-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:18 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Created reservations ['1ee4ef72-5aa7-47d3-a0ee-eee8cada4e8b'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-25f8990d-800b-44fc-bd79-51c84337a1d6 1073741824" returned: 0 in 0.857s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Lock "cinder-74d57093-426c-4d06-96cb-325597942775-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-25f8990d-800b-44fc-bd79-51c84337a1d6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:18 devstack cinder-volume[81538]: WARNING cinder.quota [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1982523109 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1982523109, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:13:18 devstack cinder-volume[81538]: WARNING cinder.quota [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1982523109 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1982523109, it is now deprecated. Please use the default quota class for default quota.
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Acquiring lock "cinder-quobyte-74d57093-426c-4d06-96cb-325597942775" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:18 devstack sudo[88056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-25f8990d-800b-44fc-bd79-51c84337a1d6
Apr 27 15:13:18 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Lock "cinder-quobyte-74d57093-426c-4d06-96cb-325597942775" acquired by "delete_volume" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Created reservations ['d62fa111-559f-4093-850f-952798526350', '7840ffa9-3034-4773-9bc2-6ae41beaf95d', 'cb1ee50f-94b7-4ef7-840a-fcb8fad741d4', '2303dddd-ae60-4a7d-bddf-40be743ad5ed'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de10a2d-0561-4a41-9d57-fe7ea9fb1524]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-74d57093-426c-4d06-96cb-325597942775 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Created reservations ['efa98a76-2fd8-49c7-9aed-d33463548abc', '2e0146e1-3447-43f0-9971-c881bd06d057', '80e59306-201d-48c9-916c-5372439f5a4a', '57605c00-b3e0-45c3-b27e-224a360df218'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:13:18 devstack sudo[88058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-74d57093-426c-4d06-96cb-325597942775
Apr 27 15:13:18 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:18 devstack sudo[88060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:13:18 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:19 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-25f8990d-800b-44fc-bd79-51c84337a1d6" returned: 0 in 0.655s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d276d8f6-4a16-4355-963c-2d8ef62d8661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f8990d-800b-44fc-bd79-51c84337a1d6', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bfd123-4b2d-486c-a5a5-012093150775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:19 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Volume volume-25f8990d-800b-44fc-bd79-51c84337a1d6 (25f8990d-800b-44fc-bd79-51c84337a1d6): created successfully
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bfd123-4b2d-486c-a5a5-012093150775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Flow 'volume_create_manager' (1ec4cb85-60b7-4942-8e1c-ca822034c217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:19 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-05905ed2-65ad-4c4b-9453-6d63ab2d40e8 tempest-VolumesTransfersV357Test-1388401655 None] Created volume successfully.
Apr 27 15:13:19 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-74d57093-426c-4d06-96cb-325597942775" returned: 0 in 0.797s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-74d57093-426c-4d06-96cb-325597942775 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:19 devstack sudo[88067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-74d57093-426c-4d06-96cb-325597942775
Apr 27 15:13:19 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:19 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.584s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:13:19 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e4f9fab7-7e5c-42e6-98ac-539bbf0b55c3 tempest-GroupsTest-1189300331 None] Delete group completed successfully.
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Acquiring lock "cinder-25f8990d-800b-44fc-bd79-51c84337a1d6-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Lock "cinder-25f8990d-800b-44fc-bd79-51c84337a1d6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Acquiring lock "cinder-quobyte-25f8990d-800b-44fc-bd79-51c84337a1d6" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Lock "cinder-quobyte-25f8990d-800b-44fc-bd79-51c84337a1d6" acquired by "delete_volume" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:20 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-74d57093-426c-4d06-96cb-325597942775" returned: 0 in 0.644s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Lock "cinder-quobyte-74d57093-426c-4d06-96cb-325597942775" released by "delete_volume" :: held 1.494s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:20 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[342b47db-d005-45e9-a2bf-6b46833c7068]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-25f8990d-800b-44fc-bd79-51c84337a1d6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:20 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Created reservations ['095fa591-7a41-4b8b-a66c-eb5876dd6416', '3dc9fccf-ee62-4a66-b203-f6d3191a6b72', 'b0626881-09a0-4baf-8f17-befb20a848f7', 'f8fa0113-9fd6-41b2-b575-e1fb18621a46'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:13:20 devstack sudo[88070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-25f8990d-800b-44fc-bd79-51c84337a1d6
Apr 27 15:13:20 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:20 devstack sudo[88072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:13:20 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:20 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-25f8990d-800b-44fc-bd79-51c84337a1d6" returned: 0 in 0.891s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-25f8990d-800b-44fc-bd79-51c84337a1d6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:21 devstack sudo[88078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-25f8990d-800b-44fc-bd79-51c84337a1d6
Apr 27 15:13:21 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:21 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.804s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:21 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:13:21 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Deleted volume successfully.
Apr 27 15:13:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-372c775e-ae40-432a-be31-b5e596ace498 tempest-VolumesCloneNegativeTest-223470494 None] Lock "cinder-74d57093-426c-4d06-96cb-325597942775-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:21 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-25f8990d-800b-44fc-bd79-51c84337a1d6" returned: 0 in 0.696s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Lock "cinder-quobyte-25f8990d-800b-44fc-bd79-51c84337a1d6" released by "delete_volume" :: held 1.680s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:21 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Created reservations ['43e072d9-93d4-4c5e-bf80-84639099f7d4', 'd6b58ce1-d7a0-44eb-8050-8f4133fcc226', 'f248f389-09d2-409f-be83-a7bc3801641b', 'bc83342a-ca9f-4eea-b279-b9cdbde59d18'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:13:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:21 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:21 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:21 devstack sudo[88081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:13:21 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Flow 'volume_create_manager' (98acfa19-5b7c-495f-9d40-c178a55443c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d404241-9455-4d66-b2df-49c7e1d2d1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d404241-9455-4d66-b2df-49c7e1d2d1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1347482250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1913dea1a03e4190af71ca88cb8e7272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:22Z,use_quota=True,user_id='85706396fa7a44a2aac2aa5ef6d83a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8141f4b9-fe52-4e18-ab6e-88e1a6a8e29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8141f4b9-fe52-4e18-ab6e-88e1a6a8e29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f01a36-19bf-4323-9c57-94baafe18c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f01a36-19bf-4323-9c57-94baafe18c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb', 'volume_name': 'volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6c845d-6632-4f3d-aee3-f716445b566f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6c845d-6632-4f3d-aee3-f716445b566f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf81195-7ad3-4ef1-8480-dc57d575c2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:22 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Volume 20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb', 'volume_size': 1}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1347482250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1913dea1a03e4190af71ca88cb8e7272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:22Z,use_quota=True,user_id='85706396fa7a44a2aac2aa5ef6d83a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Creating volume 20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:13:22 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:22 devstack sudo[88083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb 1073741824
Apr 27 15:13:22 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:22 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.807s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:13:22 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Deleted volume successfully.
Apr 27 15:13:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-11909a75-fd64-46a8-b754-b8eb1ce0d2b0 tempest-VolumesTransfersV357Test-1354160268 None] Lock "cinder-25f8990d-800b-44fc-bd79-51c84337a1d6-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:23 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb 1073741824" returned: 0 in 0.905s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:23 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb
Apr 27 15:13:23 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:23 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb" returned: 0 in 0.578s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:23 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:13:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:23 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf81195-7ad3-4ef1-8480-dc57d575c2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:23 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a989d429-90df-4009-a2c3-4c8a7d78a283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:23 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Volume volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb (20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb): created successfully
Apr 27 15:13:23 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a989d429-90df-4009-a2c3-4c8a7d78a283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:23 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Flow 'volume_create_manager' (98acfa19-5b7c-495f-9d40-c178a55443c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:23 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-9fa545ea-b291-4ac6-9cfb-0bee30e281ec tempest-SnapshotDependencyTests-1991427424 None] Created volume successfully.
Apr 27 15:13:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] Creating offline snapshot 35708484-a78f-4712-9d86-de10a59ef4e2 of volume 20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:13:24 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6d4550-0193-467f-b0e9-4469c4bbbf78]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:24 devstack sudo[88092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb
Apr 27 15:13:24 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:25 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb" returned: 0 in 0.758s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:25 devstack sudo[88097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2 1G
Apr 27 15:13:25 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:26 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2 1G" returned: 0 in 0.875s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:26 devstack sudo[88102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2
Apr 27 15:13:26 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:27 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2" returned: 0 in 0.890s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:27 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2 is being set with open permissions: ugo+rw
Apr 27 15:13:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:27 devstack sudo[88107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2
Apr 27 15:13:27 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:27 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2" returned: 0 in 0.583s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:27 devstack sudo[88110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.info
Apr 27 15:13:27 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:28 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.info" returned: 0 in 0.633s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:28 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.info is being set with open permissions: ugo+rw
Apr 27 15:13:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:28 devstack sudo[88114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.info
Apr 27 15:13:28 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:29 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.info" returned: 0 in 0.589s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.436s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:29 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ed04909b-2554-4f09-8241-91dbefadcdc6 tempest-SnapshotDependencyTests-1991427424 None] Create snapshot completed successfully
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Flow 'volume_create_manager' (e53a8947-4f00-4dd5-9c5b-062fc53b6751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9758c0-8787-4dae-9ec8-7bb8911083b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9758c0-8787-4dae-9ec8-7bb8911083b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c687a8-d38b-4796-ace3-e902acc16aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1913dea1a03e4190af71ca88cb8e7272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=35708484-a78f-4712-9d86-de10a59ef4e2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:30Z,use_quota=True,user_id='85706396fa7a44a2aac2aa5ef6d83a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31532b9f-f885-4096-aba2-ecbc711a2bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31532b9f-f885-4096-aba2-ecbc711a2bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57909c0-83ee-496f-b6f4-bd36e595225b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57909c0-83ee-496f-b6f4-bd36e595225b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '96c687a8-d38b-4796-ace3-e902acc16aa8', 'volume_name': 'volume-96c687a8-d38b-4796-ace3-e902acc16aa8', 'volume_size': 1, 'snapshot_id': '35708484-a78f-4712-9d86-de10a59ef4e2'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773831a0-1867-44da-afda-2001411230d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773831a0-1867-44da-afda-2001411230d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baae7926-5a85-491f-ada4-21d9c7ac33e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:30 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Volume 96c687a8-d38b-4796-ace3-e902acc16aa8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-96c687a8-d38b-4796-ace3-e902acc16aa8', 'volume_size': 1, 'snapshot_id': '35708484-a78f-4712-9d86-de10a59ef4e2'}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "cinder-quobyte-35708484-a78f-4712-9d86-de10a59ef4e2-96c687a8-d38b-4796-ace3-e902acc16aa8" by "_create_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-quobyte-35708484-a78f-4712-9d86-de10a59ef4e2-96c687a8-d38b-4796-ace3-e902acc16aa8" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Creating volume 96c687a8-d38b-4796-ace3-e902acc16aa8 from snapshot 35708484-a78f-4712-9d86-de10a59ef4e2 {{(pid=81538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "cinder-quobyte-96c687a8-d38b-4796-ace3-e902acc16aa8" by "_copy_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-quobyte-96c687a8-d38b-4796-ace3-e902acc16aa8" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] snapshot: 35708484-a78f-4712-9d86-de10a59ef4e2, volume: 96c687a8-d38b-4796-ace3-e902acc16aa8,  {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ce8328-4a52-4b8a-80b0-878377384aa1]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:30 devstack sudo[88119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2
Apr 27 15:13:30 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:31 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2" returned: 0 in 0.641s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:13:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 27 15:13:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Creating direct copy from snapshot {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 27 15:13:31 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43ab459-10d0-4c9f-b8cc-c0590c7bdb83]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:31 devstack sudo[88124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb
Apr 27 15:13:31 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:32 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb" returned: 0 in 0.622s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:32 devstack cinder-volume[81538]: DEBUG cinder.utils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Path /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8 not found in is_blk_device check {{(pid=81538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 27 15:13:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:32 devstack sudo[88129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8
Apr 27 15:13:32 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:38 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8" returned: 0 in 6.327s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:38 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d0d8ad-e36a-4dc1-ab0e-4816054273f7]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:38 devstack sudo[88148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb
Apr 27 15:13:38 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:39 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb" returned: 0 in 0.728s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:39 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8 {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:13:39 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Converted 1024.00 MB image at 161.81 MB/s
Apr 27 15:13:39 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8 is being set with open permissions: ugo+rw
Apr 27 15:13:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:39 devstack sudo[88153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8
Apr 27 15:13:39 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:39 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8" returned: 0 in 0.640s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-quobyte-96c687a8-d38b-4796-ace3-e902acc16aa8" released by "_copy_volume_from_snapshot" :: held 9.072s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-quobyte-35708484-a78f-4712-9d86-de10a59ef4e2-96c687a8-d38b-4796-ace3-e902acc16aa8" released by "_create_volume_from_snapshot" :: held 9.110s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.130s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baae7926-5a85-491f-ada4-21d9c7ac33e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96c687a8-d38b-4796-ace3-e902acc16aa8', 'volume_size': 1, 'snapshot_id': '35708484-a78f-4712-9d86-de10a59ef4e2'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5add63f3-a54c-4d90-b3bc-11ba0629f362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:39 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Volume volume-96c687a8-d38b-4796-ace3-e902acc16aa8 (96c687a8-d38b-4796-ace3-e902acc16aa8): created successfully
Apr 27 15:13:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5add63f3-a54c-4d90-b3bc-11ba0629f362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Flow 'volume_create_manager' (e53a8947-4f00-4dd5-9c5b-062fc53b6751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-9b2fcd32-25e5-4416-bed7-0b3ba9745b7b tempest-SnapshotDependencyTests-1991427424 None] Created volume successfully.
Apr 27 15:13:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "cinder-35708484-a78f-4712-9d86-de10a59ef4e2-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-35708484-a78f-4712-9d86-de10a59ef4e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "cinder-quobyte-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-quobyte-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "cinder-quobyte-35708484-a78f-4712-9d86-de10a59ef4e2" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-quobyte-35708484-a78f-4712-9d86-de10a59ef4e2" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Deleting offline snapshot 35708484-a78f-4712-9d86-de10a59ef4e2 of volume 20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:13:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] snapshot_file for this snap is: volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:13:40 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6840881a-037e-4ff9-ba1b-04b786a9ccae]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:40 devstack sudo[88156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2
Apr 27 15:13:40 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:41 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2" returned: 0 in 0.956s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcc7912-4199-498c-98be-f9bd8d3d06f8]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Flow 'volume_create_manager' (c51defc4-634f-4a70-9153-8abeb51b1d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2913ee94-2bf7-4ec3-99ce-8acec27f6e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:41 devstack sudo[88161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb
Apr 27 15:13:41 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2913ee94-2bf7-4ec3-99ce-8acec27f6e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1990897651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71619dde-e004-4d18-a9f8-667e12adb1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0806b1138124487aa95277c13b8a2736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:42Z,use_quota=True,user_id='5c50e184e146455385f127886ba4fd4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362e3abf-c1e6-49f6-b4c9-e7c9963275ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362e3abf-c1e6-49f6-b4c9-e7c9963275ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eed0149-a168-49fd-a644-8ee203dab5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eed0149-a168-49fd-a644-8ee203dab5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71619dde-e004-4d18-a9f8-667e12adb1b5', 'volume_name': 'volume-71619dde-e004-4d18-a9f8-667e12adb1b5', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c88c3e8-2585-4561-8f2c-914143bf30c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c88c3e8-2585-4561-8f2c-914143bf30c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdc5bd9-33b2-4906-9569-5bfe9d8b22aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:41 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Volume 71619dde-e004-4d18-a9f8-667e12adb1b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71619dde-e004-4d18-a9f8-667e12adb1b5', 'volume_size': 1}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1990897651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71619dde-e004-4d18-a9f8-667e12adb1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0806b1138124487aa95277c13b8a2736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:42Z,use_quota=True,user_id='5c50e184e146455385f127886ba4fd4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Creating volume 71619dde-e004-4d18-a9f8-667e12adb1b5 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:13:41 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:13:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:41 devstack sudo[88163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5 1073741824
Apr 27 15:13:41 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:42 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb" returned: 0 in 0.736s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:42 devstack sudo[88168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2
Apr 27 15:13:42 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:42 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5 1073741824" returned: 0 in 1.152s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:43 devstack sudo[88173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5
Apr 27 15:13:43 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:43 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2" returned: 0 in 0.953s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:43 devstack sudo[88178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2
Apr 27 15:13:43 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Flow 'volume_create_manager' (2308143d-c286-4857-bf71-09028957f563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70bd958-1453-4d2f-a2d1-8f8209e505a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70bd958-1453-4d2f-a2d1-8f8209e505a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1468966605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3074e0-b156-48d7-b161-2170962e562b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2373087f8464e02a6d38bc370aaf58d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:43Z,use_quota=True,user_id='e55a6379aa734c1b9010d4cf57549f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5a8b93-5342-4a05-9b3e-557fccf4039e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5a8b93-5342-4a05-9b3e-557fccf4039e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763ff015-e54e-498f-bf8f-a512db272b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763ff015-e54e-498f-bf8f-a512db272b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c3074e0-b156-48d7-b161-2170962e562b', 'volume_name': 'volume-3c3074e0-b156-48d7-b161-2170962e562b', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5cd9ec-a0a1-4a14-afed-3df5dfb6e5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5cd9ec-a0a1-4a14-afed-3df5dfb6e5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a62a19-5175-4668-a9aa-3cdff9828b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:43 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Volume 3c3074e0-b156-48d7-b161-2170962e562b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c3074e0-b156-48d7-b161-2170962e562b', 'volume_size': 1}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:43 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5" returned: 0 in 0.643s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.144s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1468966605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3074e0-b156-48d7-b161-2170962e562b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2373087f8464e02a6d38bc370aaf58d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:43Z,use_quota=True,user_id='e55a6379aa734c1b9010d4cf57549f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Creating volume 3c3074e0-b156-48d7-b161-2170962e562b {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:13:43 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3c3074e0-b156-48d7-b161-2170962e562b 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdc5bd9-33b2-4906-9569-5bfe9d8b22aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71619dde-e004-4d18-a9f8-667e12adb1b5', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f19713-ade2-4f90-b26a-2ce00f2122c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:43 devstack sudo[88181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3c3074e0-b156-48d7-b161-2170962e562b 1073741824
Apr 27 15:13:43 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:43 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Volume volume-71619dde-e004-4d18-a9f8-667e12adb1b5 (71619dde-e004-4d18-a9f8-667e12adb1b5): created successfully
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f19713-ade2-4f90-b26a-2ce00f2122c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Flow 'volume_create_manager' (c51defc4-634f-4a70-9153-8abeb51b1d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:43 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-2c8da871-23d1-4bf1-81b7-18e7f9fcb81c tempest-VolumesSnapshotTestJSON-1179414594 None] Created volume successfully.
Apr 27 15:13:43 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb.35708484-a78f-4712-9d86-de10a59ef4e2" returned: 0 in 0.580s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-quobyte-35708484-a78f-4712-9d86-de10a59ef4e2" released by "_delete_snapshot" :: held 3.403s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-quobyte-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb" released by "delete_snapshot" :: held 3.441s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:44 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Created reservations ['34f94ea6-83a9-4a78-b705-0f72a65ea217', 'd76df38c-04a6-4542-91ae-d1bc05823db0', '0e850e76-1f55-472e-a60f-2024d7f0d5e6', 'f44bc2f2-3fc6-4735-a1d7-56fcbb0dfae3'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:13:44 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Delete snapshot completed successfully.
Apr 27 15:13:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-64f9a720-b1af-4ceb-a64b-768ed42d4142 tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-35708484-a78f-4712-9d86-de10a59ef4e2-delete_snapshot" released by "delete_snapshot" :: held 3.599s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:44 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3c3074e0-b156-48d7-b161-2170962e562b 1073741824" returned: 0 in 0.676s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3c3074e0-b156-48d7-b161-2170962e562b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:44 devstack sudo[88187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3c3074e0-b156-48d7-b161-2170962e562b
Apr 27 15:13:44 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "cinder-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "cinder-quobyte-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-quobyte-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:44 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d957dae7-3dfe-4e09-9c5f-c5047a2fffd0]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:44 devstack sudo[88189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb
Apr 27 15:13:44 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:45 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3c3074e0-b156-48d7-b161-2170962e562b" returned: 0 in 0.654s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a62a19-5175-4668-a9aa-3cdff9828b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c3074e0-b156-48d7-b161-2170962e562b', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8364560f-5469-4d07-8751-56208ba69c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] Creating offline snapshot edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0 of volume 71619dde-e004-4d18-a9f8-667e12adb1b5 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:13:45 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Volume volume-3c3074e0-b156-48d7-b161-2170962e562b (3c3074e0-b156-48d7-b161-2170962e562b): created successfully
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8364560f-5469-4d07-8751-56208ba69c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Flow 'volume_create_manager' (2308143d-c286-4857-bf71-09028957f563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4782d906-5f36-4700-bd4a-2aa43f6ee34b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:45 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-6cef623f-381f-4d70-ac9f-f9ee770bdcc6 tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Created volume successfully.
Apr 27 15:13:45 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5
Apr 27 15:13:45 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:45 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb" returned: 0 in 0.646s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:45 devstack sudo[88197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb
Apr 27 15:13:45 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:45 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5" returned: 0 in 0.727s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:45 devstack sudo[88202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0 1G
Apr 27 15:13:45 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:46 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb" returned: 0 in 0.520s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-quobyte-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb" released by "delete_volume" :: held 1.232s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Created reservations ['d62f1c56-dad7-46ec-8bf2-43d189389abc', 'd7939776-dae9-404e-bf1d-792fd21b99bb', 'f6a73b28-53da-4877-99f2-f2e85a809730', '2ee63365-a88d-4c6c-b2e8-d15c295316b1'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:13:46 devstack sudo[88205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:13:46 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Flow 'volume_create_manager' (818bd5ad-a2ca-4b6d-829e-303cf0092d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d84eb8-d10f-48e6-bd3f-e0d208e372a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d84eb8-d10f-48e6-bd3f-e0d208e372a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-154679026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0552460-2044-49c6-9c00-1a68d41774bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16094f9c9f034d278017e0447e212266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:46Z,use_quota=True,user_id='9b6996ac3f92434eb4c6d21349b92d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78054234-6882-4a3a-aacd-31385a40a5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78054234-6882-4a3a-aacd-31385a40a5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8bb5a9-a130-47b7-b3ea-e576a4c6da80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8bb5a9-a130-47b7-b3ea-e576a4c6da80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0552460-2044-49c6-9c00-1a68d41774bb', 'volume_name': 'volume-c0552460-2044-49c6-9c00-1a68d41774bb', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc909a3-b82e-4c1a-aabe-1eaf83e3ed5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc909a3-b82e-4c1a-aabe-1eaf83e3ed5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390fedc0-fb16-41da-b6cc-59c3e91afa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:46 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Volume c0552460-2044-49c6-9c00-1a68d41774bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0552460-2044-49c6-9c00-1a68d41774bb', 'volume_size': 1}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:46 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Acquiring lock "cinder-3c3074e0-b156-48d7-b161-2170962e562b-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0 1G" returned: 0 in 0.775s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71619dde-e004-4d18-a9f8-667e12adb1b5 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Lock "cinder-3c3074e0-b156-48d7-b161-2170962e562b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:46 devstack sudo[88210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71619dde-e004-4d18-a9f8-667e12adb1b5 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0
Apr 27 15:13:46 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Acquiring lock "cinder-quobyte-3c3074e0-b156-48d7-b161-2170962e562b" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Lock "cinder-quobyte-3c3074e0-b156-48d7-b161-2170962e562b" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cec28e2-fa37-4d3e-9794-6fa9e6fc3e7b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3c3074e0-b156-48d7-b161-2170962e562b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:46 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.505s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:13:46 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Deleted volume successfully.
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6fdb947d-5a77-4197-9489-282094d70fb2 tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-20e4c7eb-e26e-4ef7-ae39-5f242bbe05cb-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:46 devstack sudo[88213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3c3074e0-b156-48d7-b161-2170962e562b
Apr 27 15:13:46 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "cinder-96c687a8-d38b-4796-ace3-e902acc16aa8-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-96c687a8-d38b-4796-ace3-e902acc16aa8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "cinder-quobyte-96c687a8-d38b-4796-ace3-e902acc16aa8" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-quobyte-96c687a8-d38b-4796-ace3-e902acc16aa8" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bca875-5577-4994-83d5-883d0d0de366]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:47 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71619dde-e004-4d18-a9f8-667e12adb1b5 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0" returned: 0 in 0.549s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:47 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0 is being set with open permissions: ugo+rw
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:47 devstack sudo[88218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8
Apr 27 15:13:47 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:47 devstack sudo[88221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0
Apr 27 15:13:47 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:47 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3c3074e0-b156-48d7-b161-2170962e562b" returned: 0 in 0.570s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3c3074e0-b156-48d7-b161-2170962e562b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:47 devstack sudo[88225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3c3074e0-b156-48d7-b161-2170962e562b
Apr 27 15:13:47 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:47 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8" returned: 0 in 0.560s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:47 devstack sudo[88231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8
Apr 27 15:13:47 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:47 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0" returned: 0 in 0.504s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:47 devstack sudo[88234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.info
Apr 27 15:13:47 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:47 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3c3074e0-b156-48d7-b161-2170962e562b" returned: 0 in 0.466s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Lock "cinder-quobyte-3c3074e0-b156-48d7-b161-2170962e562b" released by "delete_volume" :: held 1.073s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Created reservations ['daf26e74-9575-4469-b915-604d4769850b', '581a1ad4-5eb7-41af-bffc-8277493cc028', '6a09e757-ddd5-4ea7-a534-4ad2d8456e88', 'd7036755-26b0-473a-a962-d54da24612b8'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:47 devstack sudo[88236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:13:47 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:48 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96c687a8-d38b-4796-ace3-e902acc16aa8" returned: 0 in 0.510s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-quobyte-96c687a8-d38b-4796-ace3-e902acc16aa8" released by "delete_volume" :: held 1.120s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:48 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.info" returned: 0 in 0.479s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:48 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.info is being set with open permissions: ugo+rw
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:48 devstack sudo[88240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.info
Apr 27 15:13:48 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Created reservations ['b8b1090b-3832-4758-bf76-89597860768a', '29c51248-4c42-4150-9805-942b40c00e5b', '82c6bc16-4e4b-4fe5-b7ea-4c02230caf13', 'c64af5ac-94ea-43ad-9158-ed4dd7a77375'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:48 devstack sudo[88244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:13:48 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:48 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.511s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:13:48 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Deleted volume successfully.
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-752ddcc4-bc5a-4887-bc58-581af4dfd1ec tempest-VolumeQuotasNegativeTestJSON-1922363081 None] Lock "cinder-3c3074e0-b156-48d7-b161-2170962e562b-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:48 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.info" returned: 0 in 0.491s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.640s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.345s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-154679026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0552460-2044-49c6-9c00-1a68d41774bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16094f9c9f034d278017e0447e212266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:46Z,use_quota=True,user_id='9b6996ac3f92434eb4c6d21349b92d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Creating volume c0552460-2044-49c6-9c00-1a68d41774bb {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:13:48 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:48 devstack sudo[88248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb 1073741824
Apr 27 15:13:48 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:48 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-c7bccb05-b029-430f-a603-5ae3975ec5e5 tempest-VolumesSnapshotTestJSON-1179414594 None] Create snapshot completed successfully
Apr 27 15:13:48 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.484s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:13:48 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Deleted volume successfully.
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1c153be5-2bc5-405d-a0a5-da36bc249d7b tempest-SnapshotDependencyTests-1991427424 None] Lock "cinder-96c687a8-d38b-4796-ace3-e902acc16aa8-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_service.periodic_task [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81538) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:48 devstack sudo[88250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:13:48 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:49 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb 1073741824" returned: 0 in 0.773s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:49 devstack sudo[88257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb
Apr 27 15:13:49 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:49 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.742s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:49 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:13:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-71619dde-e004-4d18-a9f8-667e12adb1b5" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-71619dde-e004-4d18-a9f8-667e12adb1b5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:13:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:13:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Deleting offline snapshot edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0 of volume 71619dde-e004-4d18-a9f8-667e12adb1b5 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:13:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] snapshot_file for this snap is: volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:13:49 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f207cbfa-76ef-48d0-9290-1f25e6ceb8e0]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:49 devstack sudo[88259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0
Apr 27 15:13:49 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:50 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb" returned: 0 in 0.707s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:13:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390fedc0-fb16-41da-b6cc-59c3e91afa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0552460-2044-49c6-9c00-1a68d41774bb', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbc58c6-f0c0-4e43-9656-9607b24d0595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:50 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Volume volume-c0552460-2044-49c6-9c00-1a68d41774bb (c0552460-2044-49c6-9c00-1a68d41774bb): created successfully
Apr 27 15:13:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbc58c6-f0c0-4e43-9656-9607b24d0595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Flow 'volume_create_manager' (818bd5ad-a2ca-4b6d-829e-303cf0092d34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:50 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-74018e75-9ea9-4d03-90ea-08196a6eecdb tempest-VolumesActionsTest-1423070425 None] Created volume successfully.
Apr 27 15:13:50 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0" returned: 0 in 0.644s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71619dde-e004-4d18-a9f8-667e12adb1b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:13:50 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[22021f61-40b4-42d2-8fe2-44b007d6cf8c]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:50 devstack sudo[88265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5
Apr 27 15:13:50 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:51 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5" returned: 0 in 0.658s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:51 devstack sudo[88271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0
Apr 27 15:13:51 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:51 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0" returned: 0 in 0.722s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:51 devstack sudo[88276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0
Apr 27 15:13:51 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:52 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5.edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0" returned: 0 in 0.603s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0" released by "_delete_snapshot" :: held 2.793s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-71619dde-e004-4d18-a9f8-667e12adb1b5" released by "delete_snapshot" :: held 2.830s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:52 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Created reservations ['68e937d9-8253-4969-8f2f-62f8569a279f', '2dfad5fd-e94a-4ed7-9a99-e95c6eedd46b', '76b3702d-37cd-49b7-bf42-9a8f07801a6e', '3cf28561-c8f7-4358-ae62-3ac9105a9c17'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:13:52 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Delete snapshot completed successfully.
Apr 27 15:13:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-65cba599-2997-4e43-bac7-f553a14e4467 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-edb6379c-3cf1-48d2-8ffd-6d09cf23a7e0-delete_snapshot" released by "delete_snapshot" :: held 3.071s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Flow 'volume_create_manager' (fe10588e-2c74-437c-8ab9-2c86ec8dc799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c12668-8e6e-4dd7-b6c0-f03173d6d722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c12668-8e6e-4dd7-b6c0-f03173d6d722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2146700661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e05139-cb9c-4fca-a1dd-2eccd9e94df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0806b1138124487aa95277c13b8a2736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:53Z,use_quota=True,user_id='5c50e184e146455385f127886ba4fd4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4b5c8d-9507-4e0f-b560-cc2cb5f060a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4b5c8d-9507-4e0f-b560-cc2cb5f060a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae2229f-a337-48ea-8bad-de14a6ff7b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae2229f-a337-48ea-8bad-de14a6ff7b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9e05139-cb9c-4fca-a1dd-2eccd9e94df8', 'volume_name': 'volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc95c29-149f-494d-bdb7-376939e773f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc95c29-149f-494d-bdb7-376939e773f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94fa25e-e9a8-47fa-9a9f-9e4449dbfe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:53 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Volume e9e05139-cb9c-4fca-a1dd-2eccd9e94df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8', 'volume_size': 1}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2146700661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e05139-cb9c-4fca-a1dd-2eccd9e94df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0806b1138124487aa95277c13b8a2736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:53Z,use_quota=True,user_id='5c50e184e146455385f127886ba4fd4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Creating volume e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:13:53 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:13:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:53 devstack sudo[88284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 1073741824
Apr 27 15:13:53 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:54 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 1073741824" returned: 0 in 0.841s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:54 devstack sudo[88289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8
Apr 27 15:13:54 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:55 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8" returned: 0 in 0.545s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94fa25e-e9a8-47fa-9a9f-9e4449dbfe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa255f18-354a-4264-8244-30f4efb2178b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:55 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Volume volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 (e9e05139-cb9c-4fca-a1dd-2eccd9e94df8): created successfully
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa255f18-354a-4264-8244-30f4efb2178b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Flow 'volume_create_manager' (fe10588e-2c74-437c-8ab9-2c86ec8dc799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:55 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-04ab0750-40d7-4582-8224-db91797bc8c5 tempest-VolumesSnapshotTestJSON-1179414594 None] Created volume successfully.
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Flow 'volume_create_manager' (180e7654-0a35-4952-a5e7-e18e82f2d3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcfa8a9-f1cf-4916-95a6-1c4d78c64090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcfa8a9-f1cf-4916-95a6-1c4d78c64090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1889017027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5d1cd6-8940-4dbb-893d-98a213e71163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05bdaa670bb4d5aaf229d4e12e9dd93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:55Z,use_quota=True,user_id='05020d06a504451fbd3755ce05a65b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cb1f9d-a82c-4013-92fa-04ca1668321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cb1f9d-a82c-4013-92fa-04ca1668321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13abbe5-b0aa-460b-930c-e31eb1024a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13abbe5-b0aa-460b-930c-e31eb1024a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb5d1cd6-8940-4dbb-893d-98a213e71163', 'volume_name': 'volume-bb5d1cd6-8940-4dbb-893d-98a213e71163', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23716ada-ceb5-4e11-979e-569333d400c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23716ada-ceb5-4e11-979e-569333d400c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e7091c-f9e8-4cc8-9571-68d732685349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:55 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Volume bb5d1cd6-8940-4dbb-893d-98a213e71163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb5d1cd6-8940-4dbb-893d-98a213e71163', 'volume_size': 1}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1889017027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5d1cd6-8940-4dbb-893d-98a213e71163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05bdaa670bb4d5aaf229d4e12e9dd93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:13:55Z,use_quota=True,user_id='05020d06a504451fbd3755ce05a65b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Creating volume bb5d1cd6-8940-4dbb-893d-98a213e71163 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:13:55 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:55 devstack sudo[88293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163 1073741824
Apr 27 15:13:55 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:56 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163 1073741824" returned: 0 in 0.714s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:56 devstack sudo[88298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163
Apr 27 15:13:56 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:56 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163" returned: 0 in 0.606s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:13:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:13:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.928s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:13:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] Creating offline snapshot e7705e4a-5db3-4860-8434-6da939fea625 of volume e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:13:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e7091c-f9e8-4cc8-9571-68d732685349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb5d1cd6-8940-4dbb-893d-98a213e71163', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5cd45c-cf82-44f2-b84d-381cdebe9591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:13:56 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[379f89e1-2071-424b-828a-8bd3df66cd18]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:13:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:56 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Volume volume-bb5d1cd6-8940-4dbb-893d-98a213e71163 (bb5d1cd6-8940-4dbb-893d-98a213e71163): created successfully
Apr 27 15:13:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5cd45c-cf82-44f2-b84d-381cdebe9591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:13:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Flow 'volume_create_manager' (180e7654-0a35-4952-a5e7-e18e82f2d3fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:13:56 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-14d9c6fe-c5ba-41ec-a575-4f8084d5ebe5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Created volume successfully.
Apr 27 15:13:56 devstack sudo[88302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8
Apr 27 15:13:56 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:57 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8" returned: 0 in 0.638s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:57 devstack sudo[88309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625 1G
Apr 27 15:13:57 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:13:58 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625 1G" returned: 0 in 0.881s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:58 devstack sudo[88315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625
Apr 27 15:13:58 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:59 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625" returned: 0 in 0.766s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:59 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625 is being set with open permissions: ugo+rw
Apr 27 15:13:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:59 devstack sudo[88353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625
Apr 27 15:13:59 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:13:59 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root
Apr 27 15:13:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625" returned: 0 in 0.512s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:13:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:13:59 devstack sudo[88362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.info
Apr 27 15:13:59 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:00 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.info" returned: 0 in 0.552s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:00 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.info is being set with open permissions: ugo+rw
Apr 27 15:14:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:00 devstack sudo[88377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.info
Apr 27 15:14:00 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:00 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.info" returned: 0 in 0.451s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.917s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.979s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Creating offline snapshot d33047bc-5e31-4387-bf33-93a4155f9e43 of volume bb5d1cd6-8940-4dbb-893d-98a213e71163 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:14:00 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84e719a-2481-427b-a950-429846c04f8c]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:00 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-d5470d40-f279-4fb0-bc41-32d556fd416c tempest-VolumesSnapshotTestJSON-1179414594 None] Create snapshot completed successfully
Apr 27 15:14:00 devstack sudo[88380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163
Apr 27 15:14:00 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:01 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163" returned: 0 in 0.590s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:01 devstack sudo[88385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43 1G
Apr 27 15:14:01 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Flow 'volume_create_manager' (78f2c383-fcf8-411d-8ff7-34e6731216d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023c33c4-d1e4-419a-9201-130dedb71f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023c33c4-d1e4-419a-9201-130dedb71f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1067149546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5e8ed5-06bd-4083-8782-0c0760609203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0806b1138124487aa95277c13b8a2736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:14:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e7705e4a-5db3-4860-8434-6da939fea625,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:14:01Z,use_quota=True,user_id='5c50e184e146455385f127886ba4fd4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37440f71-ec25-4159-b692-1058272ff78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37440f71-ec25-4159-b692-1058272ff78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f3473c-4091-4323-be24-dbe2afbff26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f3473c-4091-4323-be24-dbe2afbff26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fa5e8ed5-06bd-4083-8782-0c0760609203', 'volume_name': 'volume-fa5e8ed5-06bd-4083-8782-0c0760609203', 'volume_size': 2, 'snapshot_id': 'e7705e4a-5db3-4860-8434-6da939fea625'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6939691c-0fd9-4e75-b6f6-ee3e1e767875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6939691c-0fd9-4e75-b6f6-ee3e1e767875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392c2980-2f36-4f2f-85b4-5c92935fc152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:01 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Volume fa5e8ed5-06bd-4083-8782-0c0760609203: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fa5e8ed5-06bd-4083-8782-0c0760609203', 'volume_size': 2, 'snapshot_id': 'e7705e4a-5db3-4860-8434-6da939fea625'}
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:01 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43 1G" returned: 0 in 0.594s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb5d1cd6-8940-4dbb-893d-98a213e71163 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:01 devstack sudo[88390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb5d1cd6-8940-4dbb-893d-98a213e71163 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43
Apr 27 15:14:01 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:02 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb5d1cd6-8940-4dbb-893d-98a213e71163 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43" returned: 0 in 0.511s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:02 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43 is being set with open permissions: ugo+rw
Apr 27 15:14:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:02 devstack sudo[88396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43
Apr 27 15:14:02 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:02 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43" returned: 0 in 0.473s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:02 devstack sudo[88399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.info
Apr 27 15:14:02 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:03 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.info" returned: 0 in 0.464s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:03 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.info is being set with open permissions: ugo+rw
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:03 devstack sudo[88405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.info
Apr 27 15:14:03 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:03 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.info" returned: 0 in 0.429s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.153s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.348s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-e7705e4a-5db3-4860-8434-6da939fea625-fa5e8ed5-06bd-4083-8782-0c0760609203" by "_create_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-e7705e4a-5db3-4860-8434-6da939fea625-fa5e8ed5-06bd-4083-8782-0c0760609203" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Creating volume fa5e8ed5-06bd-4083-8782-0c0760609203 from snapshot e7705e4a-5db3-4860-8434-6da939fea625 {{(pid=81538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-fa5e8ed5-06bd-4083-8782-0c0760609203" by "_copy_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:03 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-1f93db49-e23e-42d4-8a86-c33ff92938b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Create snapshot completed successfully
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-fa5e8ed5-06bd-4083-8782-0c0760609203" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] snapshot: e7705e4a-5db3-4860-8434-6da939fea625, volume: fa5e8ed5-06bd-4083-8782-0c0760609203,  {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6235a916-03ff-48b3-8cf4-e72b8c363533]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:03 devstack sudo[88408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625
Apr 27 15:14:03 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Acquiring lock "cinder-d33047bc-5e31-4387-bf33-93a4155f9e43-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "cinder-d33047bc-5e31-4387-bf33-93a4155f9e43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Acquiring lock "cinder-quobyte-bb5d1cd6-8940-4dbb-893d-98a213e71163" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "cinder-quobyte-bb5d1cd6-8940-4dbb-893d-98a213e71163" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Acquiring lock "cinder-quobyte-d33047bc-5e31-4387-bf33-93a4155f9e43" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "cinder-quobyte-d33047bc-5e31-4387-bf33-93a4155f9e43" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Deleting offline snapshot d33047bc-5e31-4387-bf33-93a4155f9e43 of volume bb5d1cd6-8940-4dbb-893d-98a213e71163 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] snapshot_file for this snap is: volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a489e809-fa6f-449e-a36c-8c852733f547]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:04 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625" returned: 0 in 0.585s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Creating direct copy from snapshot {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c72a40-f330-49d5-ab11-2bcfa70bdc87]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:04 devstack sudo[88413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43
Apr 27 15:14:04 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:04 devstack sudo[88414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8
Apr 27 15:14:04 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:04 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43" returned: 0 in 0.563s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:04 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb5d1cd6-8940-4dbb-893d-98a213e71163(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:14:05 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8936ff5-9d38-46b6-bd15-56abd246d577]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:05 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8" returned: 0 in 0.546s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:05 devstack cinder-volume[81538]: DEBUG cinder.utils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Path /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203 not found in is_blk_device check {{(pid=81538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 27 15:14:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:05 devstack sudo[88427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203
Apr 27 15:14:05 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:05 devstack sudo[88426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163
Apr 27 15:14:05 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:05 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163" returned: 0 in 0.586s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:05 devstack sudo[88443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43
Apr 27 15:14:05 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:07 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43" returned: 0 in 1.565s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:07 devstack sudo[88489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43
Apr 27 15:14:07 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:08 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163.d33047bc-5e31-4387-bf33-93a4155f9e43" returned: 0 in 1.753s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:08 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:UPDATE=146,cinder:SELECT=128,cinder:INSERT=34,cinder:DELETE=11 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:14:08 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:UPDATE=135,cinder:DELETE=14,cinder:SELECT=107,cinder:INSERT=31 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:14:09 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "cinder-quobyte-d33047bc-5e31-4387-bf33-93a4155f9e43" released by "_delete_snapshot" :: held 4.672s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:09 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "cinder-quobyte-bb5d1cd6-8940-4dbb-893d-98a213e71163" released by "delete_snapshot" :: held 4.722s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:09 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Created reservations ['c4cde3da-5aa3-4356-8393-b69474218ccf', 'e954a4cd-5741-4acb-9671-83cff849dbd5', '209edd98-01c8-46ad-a0a6-261d0d430d78', '4a3000ca-747d-4498-b955-32d89f17c942'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:14:09 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Delete snapshot completed successfully.
Apr 27 15:14:09 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-74f1aa30-c700-4847-907d-cb798be4622a tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "cinder-d33047bc-5e31-4387-bf33-93a4155f9e43-delete_snapshot" released by "delete_snapshot" :: held 5.076s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:09 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Acquiring lock "cinder-bb5d1cd6-8940-4dbb-893d-98a213e71163-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:09 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "cinder-bb5d1cd6-8940-4dbb-893d-98a213e71163-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Acquiring lock "cinder-quobyte-bb5d1cd6-8940-4dbb-893d-98a213e71163" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "cinder-quobyte-bb5d1cd6-8940-4dbb-893d-98a213e71163" acquired by "delete_volume" :: waited 0.082s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:10 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c08345f-69ea-4f49-9c33-a04e5746d1a0]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:10 devstack sudo[88495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163
Apr 27 15:14:10 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5c4fd268-4335-4cb3-8337-fb3ef72c8950 tempest-VolumesActionsTest-1423070425 None] Acquiring lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb" by "attach_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5c4fd268-4335-4cb3-8337-fb3ef72c8950 tempest-VolumesActionsTest-1423070425 None] Lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb" acquired by "attach_volume" :: waited 0.032s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:10 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5c4fd268-4335-4cb3-8337-fb3ef72c8950 tempest-VolumesActionsTest-1423070425 None] Attaching volume c0552460-2044-49c6-9c00-1a68d41774bb to instance 11df944f-3e84-4ccb-bec9-4e8454bffa21 at mountpoint /dev/vdb on host None.
Apr 27 15:14:10 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5c4fd268-4335-4cb3-8337-fb3ef72c8950 tempest-VolumesActionsTest-1423070425 None] Attach volume completed successfully.
Apr 27 15:14:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5c4fd268-4335-4cb3-8337-fb3ef72c8950 tempest-VolumesActionsTest-1423070425 None] Lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb" released by "attach_volume" :: held 0.165s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-08105676-0605-48e2-a4a5-0ea16cddc11e tempest-VolumesActionsTest-1423070425 None] Acquiring lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb-detach_volume" by "detach_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-08105676-0605-48e2-a4a5-0ea16cddc11e tempest-VolumesActionsTest-1423070425 None] Lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:11 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-08105676-0605-48e2-a4a5-0ea16cddc11e tempest-VolumesActionsTest-1423070425 None] Detaching volume c0552460-2044-49c6-9c00-1a68d41774bb from instance 11df944f-3e84-4ccb-bec9-4e8454bffa21.
Apr 27 15:14:11 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-08105676-0605-48e2-a4a5-0ea16cddc11e tempest-VolumesActionsTest-1423070425 None] Detach volume completed successfully.
Apr 27 15:14:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-08105676-0605-48e2-a4a5-0ea16cddc11e tempest-VolumesActionsTest-1423070425 None] Lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:11 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163" returned: 0 in 1.423s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:11 devstack sudo[88500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163
Apr 27 15:14:11 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:12 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203" returned: 0 in 7.582s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:12 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[921eab74-f9d9-4335-baba-280bfd2b4e9b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:12 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-bb5d1cd6-8940-4dbb-893d-98a213e71163" returned: 0 in 0.960s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:12 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "cinder-quobyte-bb5d1cd6-8940-4dbb-893d-98a213e71163" released by "delete_volume" :: held 2.567s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:12 devstack sudo[88504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8
Apr 27 15:14:12 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:12 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Created reservations ['a8e5056e-6be4-450e-a25c-0d4e5de8738e', '1164d4b9-d750-4d4c-8788-a690a5224bb6', 'fe2745f7-819b-4440-b9ec-6f020169cc4e', 'e58c73b2-64ad-4556-897c-97b3f1a0e38a'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:14:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:12 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:12 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:12 devstack sudo[88506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:14:12 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:13 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.575s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:13 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:14:13 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Deleted volume successfully.
Apr 27 15:14:13 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8" returned: 0 in 0.838s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:13 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8, size 1024.00 MB, duration 7.58 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203 {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:14:13 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Converted 1024.00 MB image at 135.04 MB/s
Apr 27 15:14:13 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203 is being set with open permissions: ugo+rw
Apr 27 15:14:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9eafb249-623c-4354-bb92-370a81238ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039186448 None] Lock "cinder-bb5d1cd6-8940-4dbb-893d-98a213e71163-delete_volume" released by "delete_volume" :: held 3.544s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:13 devstack sudo[88512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203
Apr 27 15:14:13 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:14 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203" returned: 0 in 0.742s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-fa5e8ed5-06bd-4083-8782-0c0760609203" released by "_copy_volume_from_snapshot" :: held 10.393s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-e7705e4a-5db3-4860-8434-6da939fea625-fa5e8ed5-06bd-4083-8782-0c0760609203" released by "_create_volume_from_snapshot" :: held 10.444s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.468s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392c2980-2f36-4f2f-85b4-5c92935fc152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5e8ed5-06bd-4083-8782-0c0760609203', 'volume_size': 2, 'snapshot_id': 'e7705e4a-5db3-4860-8434-6da939fea625'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0c1497-6ea6-4499-b109-47d4f983a845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:14 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Volume volume-fa5e8ed5-06bd-4083-8782-0c0760609203 (fa5e8ed5-06bd-4083-8782-0c0760609203): created successfully
Apr 27 15:14:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0c1497-6ea6-4499-b109-47d4f983a845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Flow 'volume_create_manager' (78f2c383-fcf8-411d-8ff7-34e6731216d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:14:14 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-fa63b58b-a47e-4289-aa53-99b8249ab905 tempest-VolumesSnapshotTestJSON-1179414594 None] Created volume successfully.
Apr 27 15:14:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-fa5e8ed5-06bd-4083-8782-0c0760609203-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-fa5e8ed5-06bd-4083-8782-0c0760609203-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-fa5e8ed5-06bd-4083-8782-0c0760609203" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-fa5e8ed5-06bd-4083-8782-0c0760609203" acquired by "delete_volume" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:14 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[221777a7-f4ad-4f29-bfc0-6bd0ed44a392]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:15 devstack sudo[88543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203
Apr 27 15:14:15 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:15 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203" returned: 0 in 0.654s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:15 devstack sudo[88549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203
Apr 27 15:14:15 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:16 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fa5e8ed5-06bd-4083-8782-0c0760609203" returned: 0 in 0.591s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:16 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-fa5e8ed5-06bd-4083-8782-0c0760609203" released by "delete_volume" :: held 1.287s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:16 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Created reservations ['edc14b1d-4dc3-4abb-a4fe-60e1d1e63e97', '93112379-c24c-4fb5-ac25-21abd7506efe', '592e30da-04d8-4884-a8d5-77faf5b457e1', 'd3498f82-0ad9-42ea-88f9-e6de95028136'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:14:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:16 devstack sudo[88553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:14:16 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:16 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.463s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:16 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:14:16 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Deleted volume successfully.
Apr 27 15:14:16 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5ed1ca50-f002-414f-a70f-bda6086c138b tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-fa5e8ed5-06bd-4083-8782-0c0760609203-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-e7705e4a-5db3-4860-8434-6da939fea625-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-e7705e4a-5db3-4860-8434-6da939fea625-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-e7705e4a-5db3-4860-8434-6da939fea625" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:17 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-e7705e4a-5db3-4860-8434-6da939fea625" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Deleting offline snapshot e7705e4a-5db3-4860-8434-6da939fea625 of volume e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:14:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] snapshot_file for this snap is: volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:14:17 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4ab7df-bdc8-4cb4-8ee1-c0edda3723a3]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:17 devstack sudo[88556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625
Apr 27 15:14:17 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:17 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625" returned: 0 in 0.558s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:14:17 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b0a85c-faec-4b63-a673-267f29da0bb8]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:17 devstack sudo[88561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8
Apr 27 15:14:17 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:18 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8" returned: 0 in 0.642s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:18 devstack sudo[88567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625
Apr 27 15:14:18 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:19 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625" returned: 0 in 0.592s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:19 devstack sudo[88572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625
Apr 27 15:14:19 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:19 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8.e7705e4a-5db3-4860-8434-6da939fea625" returned: 0 in 0.579s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-e7705e4a-5db3-4860-8434-6da939fea625" released by "_delete_snapshot" :: held 2.484s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8" released by "delete_snapshot" :: held 2.514s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:19 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Created reservations ['ba5646c7-a5b9-4c00-abd5-108a56a3970d', '05c933d3-a574-4110-b7e8-a05092dbe587', 'f959314d-af4d-4c24-b330-1999d77361ed', '76442745-af86-405c-b50b-4fbbdb265009'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:14:19 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Delete snapshot completed successfully.
Apr 27 15:14:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-619e9657-ee2a-4f7b-b1d4-4692509b3057 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-e7705e4a-5db3-4860-8434-6da939fea625-delete_snapshot" released by "delete_snapshot" :: held 2.646s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8" acquired by "delete_volume" :: waited 0.029s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:20 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c665387-12de-42ff-ad90-306ab0224b3d]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:20 devstack sudo[88578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8
Apr 27 15:14:20 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:21 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8" returned: 0 in 0.598s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:21 devstack sudo[88584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8
Apr 27 15:14:21 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:21 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8" returned: 0 in 0.514s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8" released by "delete_volume" :: held 1.181s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:21 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Created reservations ['a673a035-760f-4d72-8748-46f3878b0012', 'e74be82f-2f25-4663-80fe-8e69987df4ec', '26d9af02-537e-4503-9b2a-086a201fd37f', '130d0218-1f85-4736-8c78-df8a1d55e1aa'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:14:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:21 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:21 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:21 devstack sudo[88587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:14:21 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:22 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.516s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:22 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:14:22 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Deleted volume successfully.
Apr 27 15:14:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-97c1405f-eb78-4e21-adc9-03e7af12e851 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-e9e05139-cb9c-4fca-a1dd-2eccd9e94df8-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Flow 'volume_create_manager' (a6ddd022-d7b6-41c5-a831-ed3f43199437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f8033c-14b2-4c5f-90df-b4c2fc826816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f8033c-14b2-4c5f-90df-b4c2fc826816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1935608322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c938a8-a1b0-4325-a412-ac95385897ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0806b1138124487aa95277c13b8a2736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:14:23Z,use_quota=True,user_id='5c50e184e146455385f127886ba4fd4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802900e1-51d6-4c5f-b2a5-a05342dd8213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802900e1-51d6-4c5f-b2a5-a05342dd8213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e80b29a-f93c-4d2b-b62f-39eaa162cc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e80b29a-f93c-4d2b-b62f-39eaa162cc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c938a8-a1b0-4325-a412-ac95385897ff', 'volume_name': 'volume-35c938a8-a1b0-4325-a412-ac95385897ff', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf20f99-8e1d-43aa-9d34-8eb24b22f45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf20f99-8e1d-43aa-9d34-8eb24b22f45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3128dc7b-0739-46e3-ab39-dc64a2d80360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:23 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Volume 35c938a8-a1b0-4325-a412-ac95385897ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c938a8-a1b0-4325-a412-ac95385897ff', 'volume_size': 1}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1935608322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c938a8-a1b0-4325-a412-ac95385897ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0806b1138124487aa95277c13b8a2736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:14:23Z,use_quota=True,user_id='5c50e184e146455385f127886ba4fd4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Creating volume 35c938a8-a1b0-4325-a412-ac95385897ff {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:14:23 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:23 devstack sudo[88590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff 1073741824
Apr 27 15:14:23 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:23 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff 1073741824" returned: 0 in 0.696s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:23 devstack sudo[88595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff
Apr 27 15:14:23 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:24 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff" returned: 0 in 0.523s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:14:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3128dc7b-0739-46e3-ab39-dc64a2d80360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c938a8-a1b0-4325-a412-ac95385897ff', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba04695-33e4-4c50-a7e9-ebc1c89d053d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:24 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Volume volume-35c938a8-a1b0-4325-a412-ac95385897ff (35c938a8-a1b0-4325-a412-ac95385897ff): created successfully
Apr 27 15:14:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba04695-33e4-4c50-a7e9-ebc1c89d053d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Flow 'volume_create_manager' (a6ddd022-d7b6-41c5-a831-ed3f43199437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:14:24 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-baf5b854-2bc4-480e-a856-20dedc9405de tempest-VolumesSnapshotTestJSON-1179414594 None] Created volume successfully.
Apr 27 15:14:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] Creating offline snapshot 433dea80-47f2-4a4c-b7cc-e5eb0808ffdf of volume 35c938a8-a1b0-4325-a412-ac95385897ff {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:14:25 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ea6029-b3e0-4245-8142-29f7b0c38118]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:25 devstack sudo[88600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff
Apr 27 15:14:25 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Flow 'volume_create_manager' (2ff8a11a-c5da-4c18-b667-33b6c223fb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f78754-33fe-4fbf-ab32-1907dfdec94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f78754-33fe-4fbf-ab32-1907dfdec94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-683808278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e03690-10ad-4799-9792-d989d79996e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20d6140edac4ebfb47c61fc9e09196c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:14:26Z,use_quota=True,user_id='890f713266b34c03971244e8a033cb8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9e5099-3cd8-4b76-9258-faf289b34030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9e5099-3cd8-4b76-9258-faf289b34030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eaffe86-cf94-4fa9-9164-a7bcc496be5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eaffe86-cf94-4fa9-9164-a7bcc496be5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02e03690-10ad-4799-9792-d989d79996e8', 'volume_name': 'volume-02e03690-10ad-4799-9792-d989d79996e8', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8d7045-0387-497d-9f6f-e3b7e597bec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8d7045-0387-497d-9f6f-e3b7e597bec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1579b53b-7489-4b75-b1e1-dbc676ac4c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:26 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Volume 02e03690-10ad-4799-9792-d989d79996e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02e03690-10ad-4799-9792-d989d79996e8', 'volume_size': 1}
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:26 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff" returned: 0 in 0.743s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:26 devstack sudo[88605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf 1G
Apr 27 15:14:26 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:26 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf 1G" returned: 0 in 0.655s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c938a8-a1b0-4325-a412-ac95385897ff -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:26 devstack sudo[88618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c938a8-a1b0-4325-a412-ac95385897ff -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf
Apr 27 15:14:26 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:27 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c938a8-a1b0-4325-a412-ac95385897ff -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf" returned: 0 in 0.537s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:27 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf is being set with open permissions: ugo+rw
Apr 27 15:14:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:27 devstack sudo[88631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf
Apr 27 15:14:27 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:27 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf" returned: 0 in 0.434s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:27 devstack sudo[88634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.info
Apr 27 15:14:27 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:28 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.info" returned: 0 in 0.462s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:28 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.info is being set with open permissions: ugo+rw
Apr 27 15:14:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:28 devstack sudo[88638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.info
Apr 27 15:14:28 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:28 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.info" returned: 0 in 0.464s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.403s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.721s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:28 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-683808278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e03690-10ad-4799-9792-d989d79996e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c20d6140edac4ebfb47c61fc9e09196c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:14:26Z,use_quota=True,user_id='890f713266b34c03971244e8a033cb8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:14:28 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Creating volume 02e03690-10ad-4799-9792-d989d79996e8 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:14:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:28 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:28 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:28 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:14:28 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:14:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-02e03690-10ad-4799-9792-d989d79996e8 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:28 devstack sudo[88641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-02e03690-10ad-4799-9792-d989d79996e8 1073741824
Apr 27 15:14:28 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:28 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-2e5be742-ca59-46ac-adf8-06a9671b0047 tempest-VolumesSnapshotTestJSON-1179414594 None] Create snapshot completed successfully
Apr 27 15:14:29 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-02e03690-10ad-4799-9792-d989d79996e8 1073741824" returned: 0 in 0.639s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-02e03690-10ad-4799-9792-d989d79996e8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:29 devstack sudo[88646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-02e03690-10ad-4799-9792-d989d79996e8
Apr 27 15:14:29 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:30 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-02e03690-10ad-4799-9792-d989d79996e8" returned: 0 in 0.513s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1579b53b-7489-4b75-b1e1-dbc676ac4c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e03690-10ad-4799-9792-d989d79996e8', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c13421-e47a-4fd1-b6dd-59ee11a1027f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Flow 'volume_create_manager' (ac23a230-458f-4f31-b9f6-6d640c207c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8654e293-5c7f-4a5c-8ada-5a114309d61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8654e293-5c7f-4a5c-8ada-5a114309d61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-293822645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc7ad76-5a0a-4714-bedb-183c736e86c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0806b1138124487aa95277c13b8a2736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=433dea80-47f2-4a4c-b7cc-e5eb0808ffdf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:14:30Z,use_quota=True,user_id='5c50e184e146455385f127886ba4fd4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57201bbe-0cea-4d79-a91c-b7e26de9f2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57201bbe-0cea-4d79-a91c-b7e26de9f2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecef38ba-afe6-4264-9aa7-82950986e919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecef38ba-afe6-4264-9aa7-82950986e919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5dc7ad76-5a0a-4714-bedb-183c736e86c2', 'volume_name': 'volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2', 'volume_size': 1, 'snapshot_id': '433dea80-47f2-4a4c-b7cc-e5eb0808ffdf'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b514c9da-eecd-491c-993d-bc12d6e6dcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b514c9da-eecd-491c-993d-bc12d6e6dcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b49296-6f86-4b2c-87d1-de129220f70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:30 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Volume 5dc7ad76-5a0a-4714-bedb-183c736e86c2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2', 'volume_size': 1, 'snapshot_id': '433dea80-47f2-4a4c-b7cc-e5eb0808ffdf'}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-433dea80-47f2-4a4c-b7cc-e5eb0808ffdf-5dc7ad76-5a0a-4714-bedb-183c736e86c2" by "_create_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:30 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Volume volume-02e03690-10ad-4799-9792-d989d79996e8 (02e03690-10ad-4799-9792-d989d79996e8): created successfully
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c13421-e47a-4fd1-b6dd-59ee11a1027f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Flow 'volume_create_manager' (2ff8a11a-c5da-4c18-b667-33b6c223fb7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-433dea80-47f2-4a4c-b7cc-e5eb0808ffdf-5dc7ad76-5a0a-4714-bedb-183c736e86c2" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Creating volume 5dc7ad76-5a0a-4714-bedb-183c736e86c2 from snapshot 433dea80-47f2-4a4c-b7cc-e5eb0808ffdf {{(pid=81538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-5dc7ad76-5a0a-4714-bedb-183c736e86c2" by "_copy_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:30 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-7ccd2283-c00f-493b-b613-eb1d8a5ddf56 tempest-AbsoluteLimitsTests-1578665389 None] Created volume successfully.
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-5dc7ad76-5a0a-4714-bedb-183c736e86c2" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] snapshot: 433dea80-47f2-4a4c-b7cc-e5eb0808ffdf, volume: 5dc7ad76-5a0a-4714-bedb-183c736e86c2,  {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e9713f-8a5d-4f14-ab82-61cbb867b315]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:30 devstack sudo[88653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf
Apr 27 15:14:30 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:30 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf" returned: 0 in 0.550s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35c938a8-a1b0-4325-a412-ac95385897ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Creating direct copy from snapshot {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c856cac-ca77-40e9-9705-da5107563e88]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:30 devstack sudo[88658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff
Apr 27 15:14:30 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:31 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff" returned: 0 in 0.578s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:31 devstack cinder-volume[81538]: DEBUG cinder.utils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Path /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2 not found in is_blk_device check {{(pid=81538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 27 15:14:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:31 devstack sudo[88666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2
Apr 27 15:14:31 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Acquiring lock "cinder-02e03690-10ad-4799-9792-d989d79996e8-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Lock "cinder-02e03690-10ad-4799-9792-d989d79996e8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Acquiring lock "cinder-quobyte-02e03690-10ad-4799-9792-d989d79996e8" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Lock "cinder-quobyte-02e03690-10ad-4799-9792-d989d79996e8" acquired by "delete_volume" :: waited 0.027s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:31 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9ea45e-a340-484b-ae8f-629959fb9434]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-02e03690-10ad-4799-9792-d989d79996e8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:31 devstack sudo[88668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-02e03690-10ad-4799-9792-d989d79996e8
Apr 27 15:14:31 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:32 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-02e03690-10ad-4799-9792-d989d79996e8" returned: 0 in 0.783s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-02e03690-10ad-4799-9792-d989d79996e8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:32 devstack sudo[88694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-02e03690-10ad-4799-9792-d989d79996e8
Apr 27 15:14:32 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:33 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-02e03690-10ad-4799-9792-d989d79996e8" returned: 0 in 1.498s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:33 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Lock "cinder-quobyte-02e03690-10ad-4799-9792-d989d79996e8" released by "delete_volume" :: held 2.342s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:34 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Created reservations ['652d6595-3a4b-4ef2-b269-705fc640c3a0', 'ab26f0a0-9882-4998-8ae1-6b47de714693', '11c3271e-cda8-4f4c-a8ae-fc64f2ebaa8a', '7813b96a-2de6-4214-a120-583ff5499292'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:14:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:34 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:34 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:34 devstack sudo[88734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:14:34 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:34 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.801s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:34 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:14:34 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Deleted volume successfully.
Apr 27 15:14:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f216737f-8647-49e0-bd6d-c3c23817ba57 tempest-AbsoluteLimitsTests-1578665389 None] Lock "cinder-02e03690-10ad-4799-9792-d989d79996e8-delete_volume" released by "delete_volume" :: held 3.571s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-29054c0c-197a-4538-9ffd-d8871f9548ab tempest-VolumesActionsTest-1423070425 None] Acquiring lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb" by "attach_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-29054c0c-197a-4538-9ffd-d8871f9548ab tempest-VolumesActionsTest-1423070425 None] Lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb" acquired by "attach_volume" :: waited 0.043s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:38 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-29054c0c-197a-4538-9ffd-d8871f9548ab tempest-VolumesActionsTest-1423070425 None] Attaching volume c0552460-2044-49c6-9c00-1a68d41774bb to instance a41c2f36-7f12-4557-91ee-9b290f9857af at mountpoint /dev/vdb on host None.
Apr 27 15:14:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-29054c0c-197a-4538-9ffd-d8871f9548ab tempest-VolumesActionsTest-1423070425 None] Attach volume completed successfully.
Apr 27 15:14:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-29054c0c-197a-4538-9ffd-d8871f9548ab tempest-VolumesActionsTest-1423070425 None] Lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb" released by "attach_volume" :: held 0.152s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-734a8898-d346-4740-9156-f4ed390766a0 tempest-VolumesActionsTest-1423070425 None] Acquiring lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb-detach_volume" by "detach_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:39 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-734a8898-d346-4740-9156-f4ed390766a0 tempest-VolumesActionsTest-1423070425 None] Lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-734a8898-d346-4740-9156-f4ed390766a0 tempest-VolumesActionsTest-1423070425 None] Detaching volume c0552460-2044-49c6-9c00-1a68d41774bb from instance a41c2f36-7f12-4557-91ee-9b290f9857af.
Apr 27 15:14:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2" returned: 0 in 8.301s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:39 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[186e9ad3-264f-480b-aa12-05d05b03c423]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-734a8898-d346-4740-9156-f4ed390766a0 tempest-VolumesActionsTest-1423070425 None] Detach volume completed successfully.
Apr 27 15:14:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-734a8898-d346-4740-9156-f4ed390766a0 tempest-VolumesActionsTest-1423070425 None] Lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:39 devstack sudo[88739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff
Apr 27 15:14:39 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:40 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff" returned: 0 in 0.852s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:40 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff, size 1024.00 MB, duration 8.31 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2 {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:14:40 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Converted 1024.00 MB image at 123.27 MB/s
Apr 27 15:14:40 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2 is being set with open permissions: ugo+rw
Apr 27 15:14:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:40 devstack sudo[88745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2
Apr 27 15:14:40 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:41 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2" returned: 0 in 0.618s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-5dc7ad76-5a0a-4714-bedb-183c736e86c2" released by "_copy_volume_from_snapshot" :: held 11.021s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-433dea80-47f2-4a4c-b7cc-e5eb0808ffdf-5dc7ad76-5a0a-4714-bedb-183c736e86c2" released by "_create_volume_from_snapshot" :: held 11.068s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.098s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b49296-6f86-4b2c-87d1-de129220f70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2', 'volume_size': 1, 'snapshot_id': '433dea80-47f2-4a4c-b7cc-e5eb0808ffdf'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c9df98-d299-4493-9b29-877c2d01de66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:41 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Volume volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2 (5dc7ad76-5a0a-4714-bedb-183c736e86c2): created successfully
Apr 27 15:14:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c9df98-d299-4493-9b29-877c2d01de66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Flow 'volume_create_manager' (ac23a230-458f-4f31-b9f6-6d640c207c26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:14:41 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ad50261d-d4a6-4341-b907-4d06f95a73bf tempest-VolumesSnapshotTestJSON-1179414594 None] Created volume successfully.
Apr 27 15:14:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-5dc7ad76-5a0a-4714-bedb-183c736e86c2-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-5dc7ad76-5a0a-4714-bedb-183c736e86c2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-5dc7ad76-5a0a-4714-bedb-183c736e86c2" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-5dc7ad76-5a0a-4714-bedb-183c736e86c2" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[258e1454-ac5b-4999-8c51-52d53a9a65a5]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:42 devstack sudo[88774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2
Apr 27 15:14:42 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:42 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2" returned: 0 in 0.604s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:42 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2
Apr 27 15:14:42 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Flow 'volume_create_manager' (de0c792d-69b7-4f50-a729-227fff8c8176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcfbe2d-3888-45fc-9396-80afdff62112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcfbe2d-3888-45fc-9396-80afdff62112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2122463139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20909b61-9a4b-4e4c-b7ba-252d81d19ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa085ee7de1460d9a543464605ab6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:14:43Z,use_quota=True,user_id='92846f2b6e98454280c4c1700d229b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f39b8c6-e363-43d9-8f33-857ff9d82a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f39b8c6-e363-43d9-8f33-857ff9d82a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98e43cd-f321-4024-bdf6-af0a4a3b3219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98e43cd-f321-4024-bdf6-af0a4a3b3219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20909b61-9a4b-4e4c-b7ba-252d81d19ab3', 'volume_name': 'volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44c3042-bb95-45d4-bfa2-f9ccb6ae033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44c3042-bb95-45d4-bfa2-f9ccb6ae033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94de6df2-ea7a-41ae-940d-0231fc821b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:42 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Volume 20909b61-9a4b-4e4c-b7ba-252d81d19ab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3', 'volume_size': 1}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2122463139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20909b61-9a4b-4e4c-b7ba-252d81d19ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa085ee7de1460d9a543464605ab6d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:14:43Z,use_quota=True,user_id='92846f2b6e98454280c4c1700d229b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Creating volume 20909b61-9a4b-4e4c-b7ba-252d81d19ab3 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:14:42 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:14:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:42 devstack sudo[88782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3 1073741824
Apr 27 15:14:42 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:43 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dc7ad76-5a0a-4714-bedb-183c736e86c2" returned: 0 in 0.473s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-5dc7ad76-5a0a-4714-bedb-183c736e86c2" released by "delete_volume" :: held 1.135s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:43 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Created reservations ['86eb2202-8c4d-420c-a609-3e090c80fed4', '2d5cd31b-bfba-4b45-a284-772835964069', '330a12df-3af6-48fa-ac5b-1f2f27b82ca3', '49bc446d-254e-44d6-ba5b-df91a1756145'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:14:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:43 devstack sudo[88789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:14:43 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:43 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3 1073741824" returned: 0 in 0.681s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:43 devstack sudo[88791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3
Apr 27 15:14:43 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:43 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.552s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:43 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:14:43 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Deleted volume successfully.
Apr 27 15:14:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a4094278-ac78-4233-9a63-c30119638975 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-5dc7ad76-5a0a-4714-bedb-183c736e86c2-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:44 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3" returned: 0 in 0.538s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94de6df2-ea7a-41ae-940d-0231fc821b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4ab741-cb96-46b5-b858-1b2d93ef0f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:44 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Volume volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3 (20909b61-9a4b-4e4c-b7ba-252d81d19ab3): created successfully
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4ab741-cb96-46b5-b858-1b2d93ef0f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Flow 'volume_create_manager' (de0c792d-69b7-4f50-a729-227fff8c8176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:14:44 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ab7ce860-7a0b-44f0-a9b8-384921f45e26 tempest-VolumesMetadataTest-1965103457 None] Created volume successfully.
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-433dea80-47f2-4a4c-b7cc-e5eb0808ffdf-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-433dea80-47f2-4a4c-b7cc-e5eb0808ffdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-35c938a8-a1b0-4325-a412-ac95385897ff" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-35c938a8-a1b0-4325-a412-ac95385897ff" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-433dea80-47f2-4a4c-b7cc-e5eb0808ffdf" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-433dea80-47f2-4a4c-b7cc-e5eb0808ffdf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Deleting offline snapshot 433dea80-47f2-4a4c-b7cc-e5eb0808ffdf of volume 35c938a8-a1b0-4325-a412-ac95385897ff {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] snapshot_file for this snap is: volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ab6ff6-bfdb-4803-b341-c8e902703c1c]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:44 devstack sudo[88796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf
Apr 27 15:14:44 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:44 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf" returned: 0 in 0.555s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35c938a8-a1b0-4325-a412-ac95385897ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[052c35c1-2221-444c-a72a-10a6eff179b3]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:45 devstack sudo[88801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff
Apr 27 15:14:45 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:45 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff" returned: 0 in 0.586s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:45 devstack sudo[88806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf
Apr 27 15:14:45 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Acquiring lock "cinder-20909b61-9a4b-4e4c-b7ba-252d81d19ab3-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Lock "cinder-20909b61-9a4b-4e4c-b7ba-252d81d19ab3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Acquiring lock "cinder-quobyte-20909b61-9a4b-4e4c-b7ba-252d81d19ab3" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Lock "cinder-quobyte-20909b61-9a4b-4e4c-b7ba-252d81d19ab3" acquired by "delete_volume" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:45 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54d9fd2-cd92-41b8-82c9-df7501d32944]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:45 devstack sudo[88808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3
Apr 27 15:14:45 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:46 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf" returned: 0 in 0.620s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:46 devstack sudo[88815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf
Apr 27 15:14:46 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:46 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3" returned: 0 in 0.552s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:46 devstack sudo[88818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3
Apr 27 15:14:46 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:46 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff.433dea80-47f2-4a4c-b7cc-e5eb0808ffdf" returned: 0 in 0.484s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-433dea80-47f2-4a4c-b7cc-e5eb0808ffdf" released by "_delete_snapshot" :: held 2.351s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-35c938a8-a1b0-4325-a412-ac95385897ff" released by "delete_snapshot" :: held 2.380s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:46 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-20909b61-9a4b-4e4c-b7ba-252d81d19ab3" returned: 0 in 0.486s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Lock "cinder-quobyte-20909b61-9a4b-4e4c-b7ba-252d81d19ab3" released by "delete_volume" :: held 1.096s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Created reservations ['c50424f0-1fe9-47a6-84d4-09d3f5a58178', '9d1fa111-0364-4cb6-b8a4-e6f1c6eb5b8d', '56cd3082-96c7-48ba-9df5-ab110d5caea7', 'c1f75811-aece-4958-9468-3b6e12289916'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:14:46 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Delete snapshot completed successfully.
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-918eb808-11fc-4a3d-80ee-bc92b621ae57 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-433dea80-47f2-4a4c-b7cc-e5eb0808ffdf-delete_snapshot" released by "delete_snapshot" :: held 2.553s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Created reservations ['d2a486ce-c94b-44a4-bb57-34ebb94d69b3', 'd1b6bd9b-0514-42f2-a607-eb2c3112b3a6', '0f5872da-d692-4c7c-9f76-a102369cc771', '12605408-a0f6-4db3-be3c-aba83d82ec2f'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:46 devstack sudo[88822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:14:46 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:47 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.423s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:47 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:14:47 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Deleted volume successfully.
Apr 27 15:14:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b47e7712-269a-4f6c-b12a-1b3d6e517c51 tempest-VolumesMetadataTest-1965103457 None] Lock "cinder-20909b61-9a4b-4e4c-b7ba-252d81d19ab3-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-35c938a8-a1b0-4325-a412-ac95385897ff-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-35c938a8-a1b0-4325-a412-ac95385897ff-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-35c938a8-a1b0-4325-a412-ac95385897ff" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-35c938a8-a1b0-4325-a412-ac95385897ff" acquired by "delete_volume" :: waited 0.014s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:47 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca4be73-205e-43b5-85a6-17dd7e91b12c]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:47 devstack sudo[88825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff
Apr 27 15:14:47 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:48 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff" returned: 0 in 0.579s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:48 devstack sudo[88830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff
Apr 27 15:14:48 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:48 devstack cinder-volume[81538]: DEBUG oslo_service.periodic_task [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81538) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:14:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:48 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35c938a8-a1b0-4325-a412-ac95385897ff" returned: 0 in 0.615s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-35c938a8-a1b0-4325-a412-ac95385897ff" released by "delete_volume" :: held 1.259s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:48 devstack sudo[88834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:14:48 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:48 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Created reservations ['8493960d-7e9f-4f98-8156-7e184972671d', '0900acac-fa37-4d20-81d4-21bf53e73ae8', '3effd7d4-fee7-4939-a613-bbcd33bbf749', '72daa730-d53f-4518-b246-09c562b54d2b'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:49 devstack sudo[88836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:14:49 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:49 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.651s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:14:49 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.656s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:14:49 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Deleted volume successfully.
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0240fc11-7cf8-48dd-8933-230cc74327c6 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-35c938a8-a1b0-4325-a412-ac95385897ff-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[be85fdbb-1629-4248-80cb-c3995d20f18a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-71619dde-e004-4d18-a9f8-667e12adb1b5-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-71619dde-e004-4d18-a9f8-667e12adb1b5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "cinder-quobyte-71619dde-e004-4d18-a9f8-667e12adb1b5" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:14:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-71619dde-e004-4d18-a9f8-667e12adb1b5" acquired by "delete_volume" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:14:50 devstack sudo[88842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb
Apr 27 15:14:50 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:50 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8188cc0c-9292-4f99-a274-a22754319a8e]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:50 devstack sudo[88844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5
Apr 27 15:14:50 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:50 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb" returned: 0 in 0.691s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:50 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0fa8bd-3d31-400b-a33c-3a6f4ea2ecc9]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:50 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5" returned: 0 in 0.612s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:50 devstack sudo[88852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb
Apr 27 15:14:50 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:50 devstack sudo[88854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5
Apr 27 15:14:50 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Flow 'volume_create_manager' (df8596e3-11ac-40e0-b46b-43ae485ec7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce4a205-5c25-4333-88de-0b0aee0235ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce4a205-5c25-4333-88de-0b0aee0235ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1255558202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e890c0-89bc-4407-a3de-b523b6debdeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0489e77d0a3f4664ad718aae27cb01e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:14:51Z,use_quota=True,user_id='46f81aab91d24794806676cb40cb2bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041a2252-baed-4a8b-9d7c-e92f5b0b7fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041a2252-baed-4a8b-9d7c-e92f5b0b7fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daeaedbe-64ab-4252-a61b-ab117852c22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.image.glance [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Creating Keystone auth plugin from conf {{(pid=81538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 27 15:14:51 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb" returned: 0 in 0.609s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.f8a8717d-ff92-4473-9e21-05d663f8eef9k8rnl3ty.img {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:51 devstack sudo[88860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.f8a8717d-ff92-4473-9e21-05d663f8eef9k8rnl3ty.img
Apr 27 15:14:51 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:51 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-71619dde-e004-4d18-a9f8-667e12adb1b5" returned: 0 in 0.584s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-quobyte-71619dde-e004-4d18-a9f8-667e12adb1b5" released by "delete_volume" :: held 1.263s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Created reservations ['b610d511-2dd9-4d6d-8912-169de0bdcf8f', '307e3011-4156-4aae-8a98-8e10748fa223', '071aaa37-0e06-4708-a379-4ea3e8c8c0e4', '56bbe42c-9815-4aa1-b570-0597e7c6cf26'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daeaedbe-64ab-4252-a61b-ab117852c22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '44e890c0-89bc-4407-a3de-b523b6debdeb', 'volume_name': 'volume-44e890c0-89bc-4407-a3de-b523b6debdeb', 'volume_size': 1, 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8b5f6f0ff7c46c9826225de4a824e37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17408032-d085-42b0-a4db-fa0192e428de', 'created_at': datetime.datetime(2026, 4, 27, 13, 1, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 13, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17408032-d085-42b0-a4db-fa0192e428de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f59e55e2dd0>}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d18b15a-42d3-41a6-a223-6bb4e4107c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d18b15a-42d3-41a6-a223-6bb4e4107c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57715ef5-9204-4baa-ab0b-d699ef85a1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:14:51 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Volume 44e890c0-89bc-4407-a3de-b523b6debdeb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-44e890c0-89bc-4407-a3de-b523b6debdeb', 'volume_size': 1, 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8b5f6f0ff7c46c9826225de4a824e37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17408032-d085-42b0-a4db-fa0192e428de', 'created_at': datetime.datetime(2026, 4, 27, 13, 1, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 13, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17408032-d085-42b0-a4db-fa0192e428de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f59e55e2dd0>}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Trying to clone 44e890c0-89bc-4407-a3de-b523b6debdeb from image 17408032-d085-42b0-a4db-fa0192e428de at location (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]). {{(pid=81538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:51 devstack sudo[88862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:14:51 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xxa9iv9ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81538) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 27 15:14:51 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Image download 20.69 MB at 20.69 MB/s
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[763350c6-70f0-4676-998c-dbcd3d5744c4]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xxa9iv9ddevstack@QuobyteHD {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:52 devstack sudo[88878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xxa9iv9ddevstack@QuobyteHD
Apr 27 15:14:52 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:52 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.768s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:52 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:14:52 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Deleted volume successfully.
Apr 27 15:14:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3d63b494-5f4f-4a2d-a04c-c1bc09acd1f9 tempest-VolumesSnapshotTestJSON-1179414594 None] Lock "cinder-71619dde-e004-4d18-a9f8-667e12adb1b5-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:14:53 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xxa9iv9ddevstack@QuobyteHD" returned: 0 in 1.231s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:53 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Temporary image 17408032-d085-42b0-a4db-fa0192e428de is fetched for user 46f81aab91d24794806676cb40cb2bed. {{(pid=81538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 27 15:14:53 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f428f5-886f-47bd-be93-d62ffcbaab8e]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xxa9iv9ddevstack@QuobyteHD {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:53 devstack sudo[88883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xxa9iv9ddevstack@QuobyteHD
Apr 27 15:14:53 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:54 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xxa9iv9ddevstack@QuobyteHD" returned: 0 in 1.507s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:14:56 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.f8a8717d-ff92-4473-9e21-05d663f8eef9k8rnl3ty.img" returned: 0 in 5.248s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:56 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[865d7f03-b2d9-4b47-abd2-679e3a8d2835]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:14:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:14:56 devstack sudo[88889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb
Apr 27 15:14:56 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:14:57 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root
Apr 27 15:14:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb" returned: 0 in 0.751s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:14:57 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.f8a8717d-ff92-4473-9e21-05d663f8eef9k8rnl3ty.img {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:14:57 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] Converted 1024.00 MB image at 195.08 MB/s
Apr 27 15:14:57 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] f8a8717d-ff92-4473-9e21-05d663f8eef9 was raw, no need to convert to raw {{(pid=81538) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 27 15:15:00 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:15:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Flow 'volume_create_manager' (a3ed173a-9d41-4df2-be39-54152b0ce884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f29cbd-3301-44a8-b301-4b5d45db1b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f29cbd-3301-44a8-b301-4b5d45db1b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1963437620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b103fef8-58c4-4585-b95e-c15e04acaab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba819dab27844aca899796396b5feaf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:00Z,use_quota=True,user_id='36e682f6f47b405f8bd5e51fc9f15285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1667966-55b5-4b90-b6bf-a3086fd69353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1667966-55b5-4b90-b6bf-a3086fd69353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1fa94f-37c9-437b-915c-9672cf04a83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1fa94f-37c9-437b-915c-9672cf04a83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b103fef8-58c4-4585-b95e-c15e04acaab2', 'volume_name': 'volume-b103fef8-58c4-4585-b95e-c15e04acaab2', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7211e99f-f7f0-4427-b951-7f5bd03d025e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7211e99f-f7f0-4427-b951-7f5bd03d025e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d02a74-7918-4ce2-a363-ee480124e668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:00 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Volume b103fef8-58c4-4585-b95e-c15e04acaab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b103fef8-58c4-4585-b95e-c15e04acaab2', 'volume_size': 1}
Apr 27 15:15:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:09 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=70,cinder:INSERT=28,cinder:UPDATE=106,cinder:DELETE=4 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:15:10 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=101,cinder:INSERT=25,cinder:UPDATE=97,cinder:DELETE=10 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:15:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.423s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:13 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] Uploaded volume to glance image-id: f8a8717d-ff92-4473-9e21-05d663f8eef9. {{(pid=81538) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 27 15:15:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.512s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1255558202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e890c0-89bc-4407-a3de-b523b6debdeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0489e77d0a3f4664ad718aae27cb01e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:14:51Z,use_quota=True,user_id='46f81aab91d24794806676cb40cb2bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:15:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Creating volume 44e890c0-89bc-4407-a3de-b523b6debdeb {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:15:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:15:13 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:15:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:13 devstack sudo[88935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb 1073741824
Apr 27 15:15:13 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:13 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-513f9b5a-961e-41ac-bd80-cf976e18057e tempest-VolumesActionsTest-1423070425 None] Copy volume to image completed successfully.
Apr 27 15:15:13 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb 1073741824" returned: 0 in 0.641s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:13 devstack sudo[88940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb
Apr 27 15:15:13 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:14 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb" returned: 0 in 0.462s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.366s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1963437620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b103fef8-58c4-4585-b95e-c15e04acaab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba819dab27844aca899796396b5feaf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:00Z,use_quota=True,user_id='36e682f6f47b405f8bd5e51fc9f15285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Creating volume b103fef8-58c4-4585-b95e-c15e04acaab2 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:15:14 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:14 devstack sudo[88943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2 1073741824
Apr 27 15:15:14 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG cinder.volume.volume_utils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Attempting download of 17408032-d085-42b0-a4db-fa0192e428de ((None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}])) to volume 44e890c0-89bc-4407-a3de-b523b6debdeb. {{(pid=81538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fabaed-7f05-48c5-aaad-ac4302fa16c8]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_adt91zq4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:14 devstack sudo[88945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_adt91zq4
Apr 27 15:15:14 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:15 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_adt91zq4" returned: 0 in 0.483s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_adt91zq4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:15 devstack sudo[88952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_adt91zq4
Apr 27 15:15:15 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:15 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2 1073741824" returned: 0 in 0.648s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:15 devstack sudo[88954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2
Apr 27 15:15:15 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:15 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_adt91zq4" returned: 1 in 0.517s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_adt91zq4' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3683bafc-3314-41c0-beed-12d4576b86d6]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xxa9iv9ddevstack@QuobyteHD {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:15 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2" returned: 0 in 0.448s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.118s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4c20ed-e8a2-435b-b298-752733e4ac35]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:15 devstack sudo[88959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xxa9iv9ddevstack@QuobyteHD
Apr 27 15:15:15 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d02a74-7918-4ce2-a363-ee480124e668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b103fef8-58c4-4585-b95e-c15e04acaab2', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eae4e9b-e3e4-4a93-aaa7-b78606805652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:15 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Volume volume-b103fef8-58c4-4585-b95e-c15e04acaab2 (b103fef8-58c4-4585-b95e-c15e04acaab2): created successfully
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eae4e9b-e3e4-4a93-aaa7-b78606805652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Flow 'volume_create_manager' (a3ed173a-9d41-4df2-be39-54152b0ce884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:15 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-75981cd7-6f0f-42d7-9c2a-7a2ef5ff65a2 tempest-VolumeDependencyTests-2096246084 None] Created volume successfully.
Apr 27 15:15:15 devstack sudo[88960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb
Apr 27 15:15:15 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:16 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xxa9iv9ddevstack@QuobyteHD" returned: 0 in 0.520s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:16 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] 17408032-d085-42b0-a4db-fa0192e428de was qcow2, converting to raw {{(pid=81538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 27 15:15:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xxa9iv9ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:16 devstack sudo[88968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xxa9iv9ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb
Apr 27 15:15:16 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:16 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb" returned: 0 in 0.593s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:16 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4605ace4-40e9-4919-be97-1071107ced16]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:16 devstack sudo[88971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb
Apr 27 15:15:16 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:16 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb" returned: 0 in 0.587s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:16 devstack sudo[88989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img
Apr 27 15:15:16 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:17 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xxa9iv9ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb" returned: 0 in 1.557s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:17 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_xxa9iv9ddevstack@QuobyteHD, size 112.00 MB, duration 1.56 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:15:17 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Converted 112.00 MB image at 71.87 MB/s
Apr 27 15:15:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:17 devstack sudo[89001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb 1G
Apr 27 15:15:17 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:18 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb 1G" returned: 0 in 1.361s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:19 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f723feb7-63f7-4b85-89b9-865fb32a532f]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:19 devstack sudo[89007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb
Apr 27 15:15:19 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:20 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb" returned: 0 in 1.229s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:20 devstack sudo[89011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb
Apr 27 15:15:20 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:21 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb" returned: 1 in 1.125s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:15:21 devstack cinder-volume[81538]: DEBUG cinder.volume.volume_utils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Downloaded image 17408032-d085-42b0-a4db-fa0192e428de ((None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}])) to volume 44e890c0-89bc-4407-a3de-b523b6debdeb successfully. {{(pid=81538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 27 15:15:21 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Temporary image 17408032-d085-42b0-a4db-fa0192e428de for user 46f81aab91d24794806676cb40cb2bed is deleted. {{(pid=81538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 27 15:15:21 devstack cinder-volume[81538]: DEBUG cinder.volume.volume_utils [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Marking volume 44e890c0-89bc-4407-a3de-b523b6debdeb as bootable. {{(pid=81538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 27 15:15:21 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Copying metadata from image 17408032-d085-42b0-a4db-fa0192e428de to 44e890c0-89bc-4407-a3de-b523b6debdeb. {{(pid=81538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 27 15:15:21 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Creating volume glance metadata for volume 44e890c0-89bc-4407-a3de-b523b6debdeb backed by image 17408032-d085-42b0-a4db-fa0192e428de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 27 15:15:21 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57715ef5-9204-4baa-ab0b-d699ef85a1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e890c0-89bc-4407-a3de-b523b6debdeb', 'volume_size': 1, 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8b5f6f0ff7c46c9826225de4a824e37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17408032-d085-42b0-a4db-fa0192e428de', 'created_at': datetime.datetime(2026, 4, 27, 13, 1, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 13, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17408032-d085-42b0-a4db-fa0192e428de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f59e55e2dd0>}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:21 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbfc3362-cd4d-419b-ab5d-4090795fd451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:21 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Volume volume-44e890c0-89bc-4407-a3de-b523b6debdeb (44e890c0-89bc-4407-a3de-b523b6debdeb): created successfully
Apr 27 15:15:21 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:21 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbfc3362-cd4d-419b-ab5d-4090795fd451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:21 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Flow 'volume_create_manager' (df8596e3-11ac-40e0-b46b-43ae485ec7f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img" returned: 0 in 4.780s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:21 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-72397835-b3f3-4d64-9510-a7025ccf199e tempest-VolumesExtendTest-544272695 None] Created volume successfully.
Apr 27 15:15:21 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4f23e5-eb89-44ae-9c4d-e14e6a0240bf]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:21 devstack sudo[89016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb
Apr 27 15:15:21 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:22 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb" returned: 0 in 0.628s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:22 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb, size 1024.00 MB, duration 4.78 sec, destination /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:15:22 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Converted 1024.00 MB image at 214.19 MB/s
Apr 27 15:15:22 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] 4cca7d10-48a0-4e71-9c29-4b805300a2f1 was raw, converting to qcow2 {{(pid=81538) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 27 15:15:22 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f1fbb3-7cb6-4242-9e93-84dffd21a6bc]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:22 devstack sudo[89021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img
Apr 27 15:15:22 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-863c34b6-ef53-43a4-bd3c-bc6989018a10 tempest-VolumesExtendTest-544272695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:22 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img" returned: 0 in 0.483s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:22 devstack sudo[89025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img
Apr 27 15:15:22 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:23 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img" returned: 1 in 0.499s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:15:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img /opt/stack/data/cinder/conversion/vol_upload_quoowv0r {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:23 devstack sudo[89030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img /opt/stack/data/cinder/conversion/vol_upload_quoowv0r
Apr 27 15:15:23 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:23 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img /opt/stack/data/cinder/conversion/vol_upload_quoowv0r" returned: 0 in 0.433s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:23 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Image conversion details: src /opt/stack/data/cinder/conversion/c0552460-2044-49c6-9c00-1a68d41774bb.temp_image.4cca7d10-48a0-4e71-9c29-4b805300a2f1ujmhy8s8.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_quoowv0r {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:15:23 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 27 15:15:23 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5caf52c-8c25-4bc5-9a2d-d4928d120c8f]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_quoowv0r {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:23 devstack sudo[89035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_quoowv0r
Apr 27 15:15:23 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:24 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_quoowv0r" returned: 0 in 0.469s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.741s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Uploaded volume to glance image-id: 4cca7d10-48a0-4e71-9c29-4b805300a2f1. {{(pid=81538) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 27 15:15:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.273s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] Creating offline snapshot 954dd733-be51-4f92-8990-49facb451892 of volume b103fef8-58c4-4585-b95e-c15e04acaab2 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:15:25 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-15d9fa51-27e6-4d19-ba6f-88eda9b29253 tempest-VolumesActionsTest-1423070425 None] Copy volume to image completed successfully.
Apr 27 15:15:25 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e976d8-8565-4ae4-868a-7b3517ec9cd0]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:25 devstack sudo[89040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2
Apr 27 15:15:25 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:25 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2" returned: 0 in 0.543s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:25 devstack sudo[89045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892 1G
Apr 27 15:15:25 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Acquiring lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Acquiring lock "cinder-quobyte-c0552460-2044-49c6-9c00-1a68d41774bb" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Lock "cinder-quobyte-c0552460-2044-49c6-9c00-1a68d41774bb" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:26 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f11662-6213-49fd-a159-5c5659c3cb32]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:26 devstack sudo[89050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb
Apr 27 15:15:26 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:26 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892 1G" returned: 0 in 0.634s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b103fef8-58c4-4585-b95e-c15e04acaab2 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:26 devstack sudo[89052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b103fef8-58c4-4585-b95e-c15e04acaab2 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892
Apr 27 15:15:26 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:26 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb" returned: 0 in 0.540s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:27 devstack sudo[89060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb
Apr 27 15:15:27 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:27 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b103fef8-58c4-4585-b95e-c15e04acaab2 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892" returned: 0 in 0.493s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:27 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892 is being set with open permissions: ugo+rw
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:27 devstack sudo[89062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892
Apr 27 15:15:27 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:27 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-c0552460-2044-49c6-9c00-1a68d41774bb" returned: 0 in 0.430s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Lock "cinder-quobyte-c0552460-2044-49c6-9c00-1a68d41774bb" released by "delete_volume" :: held 1.021s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:27 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892" returned: 0 in 0.444s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Created reservations ['5027723b-6a00-45da-9267-434fadc6e669', '8c29b90d-49c2-477b-998c-3009a22224b7', '3d9d138d-b6e4-44ed-9c1b-23050a01fd47', '346194d4-5fdc-42b9-9989-bedfea819e0b'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:27 devstack sudo[89066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.info
Apr 27 15:15:27 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:27 devstack sudo[89068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:15:27 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:27 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.info" returned: 0 in 0.457s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:27 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.info is being set with open permissions: ugo+rw
Apr 27 15:15:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:28 devstack sudo[89072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.info
Apr 27 15:15:28 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:28 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.440s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:28 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:15:28 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Deleted volume successfully.
Apr 27 15:15:28 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-ce0b32ff-31e2-4ab0-823e-f1d8fab9ade0 tempest-VolumesActionsTest-1423070425 None] Lock "cinder-c0552460-2044-49c6-9c00-1a68d41774bb-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:28 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.info" returned: 0 in 0.452s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.131s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-863c34b6-ef53-43a4-bd3c-bc6989018a10 tempest-VolumesExtendTest-544272695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 5.931s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:28 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-70943ce8-1065-4de0-9cb9-06e540fd39fa tempest-VolumeDependencyTests-2096246084 None] Create snapshot completed successfully
Apr 27 15:15:28 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8449ae15-1f1e-4c84-adb7-f26997f5fbe8]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-863c34b6-ef53-43a4-bd3c-bc6989018a10 tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:28 devstack sudo[89076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb
Apr 27 15:15:28 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Flow 'volume_create_manager' (57b29615-dbbc-4fd2-934a-80e04a4e7ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:29 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5f28a0-fdfa-4d42-8292-bc7c251ee5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-863c34b6-ef53-43a4-bd3c-bc6989018a10 tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb" returned: 0 in 0.589s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-863c34b6-ef53-43a4-bd3c-bc6989018a10 tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5f28a0-fdfa-4d42-8292-bc7c251ee5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1718256339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa562f8-36ce-4434-937c-c4504b363554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba819dab27844aca899796396b5feaf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=954dd733-be51-4f92-8990-49facb451892,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:29Z,use_quota=True,user_id='36e682f6f47b405f8bd5e51fc9f15285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91069e5f-0ba1-441e-9b7b-f06748113765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91069e5f-0ba1-441e-9b7b-f06748113765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175e8913-bcc7-46d6-8829-2b817b1cc2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175e8913-bcc7-46d6-8829-2b817b1cc2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cfa562f8-36ce-4434-937c-c4504b363554', 'volume_name': 'volume-cfa562f8-36ce-4434-937c-c4504b363554', 'volume_size': 1, 'snapshot_id': '954dd733-be51-4f92-8990-49facb451892'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8b7c71-4d07-407b-836a-745f86a794a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8b7c71-4d07-407b-836a-745f86a794a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6ae6e0-5293-404a-b594-5e498bc00bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:29 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Volume cfa562f8-36ce-4434-937c-c4504b363554: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cfa562f8-36ce-4434-937c-c4504b363554', 'volume_size': 1, 'snapshot_id': '954dd733-be51-4f92-8990-49facb451892'}
Apr 27 15:15:29 devstack sudo[89080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb
Apr 27 15:15:29 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:29 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-863c34b6-ef53-43a4-bd3c-bc6989018a10 tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb" returned: 1 in 0.575s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-863c34b6-ef53-43a4-bd3c-bc6989018a10 tempest-VolumesExtendTest-544272695 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-863c34b6-ef53-43a4-bd3c-bc6989018a10 tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb 2G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-863c34b6-ef53-43a4-bd3c-bc6989018a10 tempest-VolumesExtendTest-544272695 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb 2G" returned: 0 in 0.059s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-863c34b6-ef53-43a4-bd3c-bc6989018a10 tempest-VolumesExtendTest-544272695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.274s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.565s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-quobyte-954dd733-be51-4f92-8990-49facb451892-cfa562f8-36ce-4434-937c-c4504b363554" by "_create_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-954dd733-be51-4f92-8990-49facb451892-cfa562f8-36ce-4434-937c-c4504b363554" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Creating volume cfa562f8-36ce-4434-937c-c4504b363554 from snapshot 954dd733-be51-4f92-8990-49facb451892 {{(pid=81538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-quobyte-cfa562f8-36ce-4434-937c-c4504b363554" by "_copy_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-cfa562f8-36ce-4434-937c-c4504b363554" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] snapshot: 954dd733-be51-4f92-8990-49facb451892, volume: cfa562f8-36ce-4434-937c-c4504b363554,  {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a20151e-8bff-4462-8a6a-7347d29b5a15]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:29 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-863c34b6-ef53-43a4-bd3c-bc6989018a10 tempest-VolumesExtendTest-544272695 None] Extend volume completed successfully.
Apr 27 15:15:29 devstack sudo[89089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892
Apr 27 15:15:29 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Acquiring lock "cinder-44e890c0-89bc-4407-a3de-b523b6debdeb-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Lock "cinder-44e890c0-89bc-4407-a3de-b523b6debdeb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Acquiring lock "cinder-quobyte-44e890c0-89bc-4407-a3de-b523b6debdeb" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Lock "cinder-quobyte-44e890c0-89bc-4407-a3de-b523b6debdeb" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:30 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bde6abe-3c46-469e-b1e3-6819b24810e7]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:30 devstack sudo[89094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb
Apr 27 15:15:30 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:30 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892" returned: 0 in 0.630s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b103fef8-58c4-4585-b95e-c15e04acaab2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:15:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2 {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 27 15:15:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Creating direct copy from snapshot {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 27 15:15:30 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[455697aa-380b-4a88-ad18-5009996116f1]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:30 devstack sudo[89097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2
Apr 27 15:15:30 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:30 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb" returned: 0 in 0.550s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:31 devstack sudo[89101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb
Apr 27 15:15:31 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:31 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2" returned: 0 in 0.623s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:31 devstack cinder-volume[81538]: DEBUG cinder.utils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Path /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554 not found in is_blk_device check {{(pid=81538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 27 15:15:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:31 devstack sudo[89106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554
Apr 27 15:15:31 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:31 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb" returned: 1 in 0.679s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:15:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:31 devstack sudo[89111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb
Apr 27 15:15:31 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:32 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-44e890c0-89bc-4407-a3de-b523b6debdeb" returned: 0 in 0.875s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:32 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Lock "cinder-quobyte-44e890c0-89bc-4407-a3de-b523b6debdeb" released by "delete_volume" :: held 2.207s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:32 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Created reservations ['938b03da-97ff-4b5b-a80b-462fe7974d1d', '0c81a61b-0d64-457e-a695-5d265a523daa', '51050b68-33ea-41e5-9b24-48343c2cf65b', '8dee8998-4640-43d2-ace9-ffb446805208'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:15:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:32 devstack sudo[89125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:15:32 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:34 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 1.459s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:15:34 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Deleted volume successfully.
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9bba0ba0-b3a5-44f4-aa7d-969117dc19e9 tempest-VolumesExtendTest-544272695 None] Lock "cinder-44e890c0-89bc-4407-a3de-b523b6debdeb-delete_volume" released by "delete_volume" :: held 4.158s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Flow 'volume_create_manager' (6ef18917-38c8-4dac-83d5-ec488b2fd0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5022691-2da2-47e1-a99a-3cc6dc05476f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5022691-2da2-47e1-a99a-3cc6dc05476f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-683671065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd3b796-7032-47a8-8957-10e5360ec676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0489e77d0a3f4664ad718aae27cb01e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:35Z,use_quota=True,user_id='46f81aab91d24794806676cb40cb2bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9579a3be-4111-4d6f-bd58-fbd0c6d1dbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9579a3be-4111-4d6f-bd58-fbd0c6d1dbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d5fe34-45b9-4863-9268-4d0bb21a7810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d5fe34-45b9-4863-9268-4d0bb21a7810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd3b796-7032-47a8-8957-10e5360ec676', 'volume_name': 'volume-2fd3b796-7032-47a8-8957-10e5360ec676', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f47093-3172-4a17-a5ba-1735822a0249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f47093-3172-4a17-a5ba-1735822a0249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b487f8-68d1-47db-ae9b-4455c7f500e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:34 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Volume 2fd3b796-7032-47a8-8957-10e5360ec676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd3b796-7032-47a8-8957-10e5360ec676', 'volume_size': 1}
Apr 27 15:15:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:36 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554" returned: 0 in 5.818s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:36 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac71042-6672-437f-be3d-e481aab0be65]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:37 devstack sudo[89134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2
Apr 27 15:15:37 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Flow 'volume_create_manager' (cf915ab9-0fdf-48e5-95f3-fce91f7acea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab8ecb6-1610-4853-90ff-dac4bee1d155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab8ecb6-1610-4853-90ff-dac4bee1d155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-172498965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279609e9-fc62-496f-b719-378996769c9d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='92152e044e9542b19af465690dddcc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:37Z,use_quota=True,user_id='e32c49961c37419dbab449edec51198d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab354f23-4d1a-4e40-93fe-02abb8bdcd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab354f23-4d1a-4e40-93fe-02abb8bdcd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f54a056-82b3-4091-935c-7594dad30fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f54a056-82b3-4091-935c-7594dad30fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279609e9-fc62-496f-b719-378996769c9d', 'volume_name': 'volume-279609e9-fc62-496f-b719-378996769c9d', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c6f44d-690a-4516-85a3-92a73dc54489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c6f44d-690a-4516-85a3-92a73dc54489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d4d10e-ec99-476e-8c96-bc59210a28fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:37 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Volume 279609e9-fc62-496f-b719-378996769c9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279609e9-fc62-496f-b719-378996769c9d', 'volume_size': 1}
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:37 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2" returned: 0 in 0.675s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554 {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:15:37 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Converted 1024.00 MB image at 175.98 MB/s
Apr 27 15:15:37 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554 is being set with open permissions: ugo+rw
Apr 27 15:15:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:37 devstack sudo[89139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554
Apr 27 15:15:37 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:38 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554" returned: 0 in 0.437s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-cfa562f8-36ce-4434-937c-c4504b363554" released by "_copy_volume_from_snapshot" :: held 8.290s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-954dd733-be51-4f92-8990-49facb451892-cfa562f8-36ce-4434-937c-c4504b363554" released by "_create_volume_from_snapshot" :: held 8.326s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.354s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.203s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-683671065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd3b796-7032-47a8-8957-10e5360ec676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0489e77d0a3f4664ad718aae27cb01e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:35Z,use_quota=True,user_id='46f81aab91d24794806676cb40cb2bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Creating volume 2fd3b796-7032-47a8-8957-10e5360ec676 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:15:38 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:38 devstack sudo[89142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676 1073741824
Apr 27 15:15:38 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6ae6e0-5293-404a-b594-5e498bc00bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa562f8-36ce-4434-937c-c4504b363554', 'volume_size': 1, 'snapshot_id': '954dd733-be51-4f92-8990-49facb451892'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faac1ca3-00c3-4b38-9e8b-8893fb6e45f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:38 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Volume volume-cfa562f8-36ce-4434-937c-c4504b363554 (cfa562f8-36ce-4434-937c-c4504b363554): created successfully
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faac1ca3-00c3-4b38-9e8b-8893fb6e45f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Flow 'volume_create_manager' (57b29615-dbbc-4fd2-934a-80e04a4e7ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:38 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-59a39cfa-fcac-4ba3-bd89-396c474da91d tempest-VolumeDependencyTests-2096246084 None] Created volume successfully.
Apr 27 15:15:38 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676 1073741824" returned: 0 in 0.590s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:38 devstack sudo[89148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676
Apr 27 15:15:38 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-954dd733-be51-4f92-8990-49facb451892-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-954dd733-be51-4f92-8990-49facb451892-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-quobyte-b103fef8-58c4-4585-b95e-c15e04acaab2" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-b103fef8-58c4-4585-b95e-c15e04acaab2" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-quobyte-954dd733-be51-4f92-8990-49facb451892" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-954dd733-be51-4f92-8990-49facb451892" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Deleting offline snapshot 954dd733-be51-4f92-8990-49facb451892 of volume b103fef8-58c4-4585-b95e-c15e04acaab2 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] snapshot_file for this snap is: volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e062e2c9-940a-4796-8a25-9d4c1e769944]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:39 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676" returned: 0 in 0.496s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:39 devstack sudo[89151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892
Apr 27 15:15:39 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.065s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-172498965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279609e9-fc62-496f-b719-378996769c9d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='92152e044e9542b19af465690dddcc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:37Z,use_quota=True,user_id='e32c49961c37419dbab449edec51198d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Creating volume 279609e9-fc62-496f-b719-378996769c9d {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:15:39 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-279609e9-fc62-496f-b719-378996769c9d 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b487f8-68d1-47db-ae9b-4455c7f500e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd3b796-7032-47a8-8957-10e5360ec676', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:39 devstack sudo[89153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-279609e9-fc62-496f-b719-378996769c9d 1073741824
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d246ef-d968-4c51-991c-32cec4b2c57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:39 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:39 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Volume volume-2fd3b796-7032-47a8-8957-10e5360ec676 (2fd3b796-7032-47a8-8957-10e5360ec676): created successfully
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d246ef-d968-4c51-991c-32cec4b2c57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Flow 'volume_create_manager' (6ef18917-38c8-4dac-83d5-ec488b2fd0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f8386f98-a95c-4c07-9395-54d343133d90 tempest-VolumesExtendTest-544272695 None] Created volume successfully.
Apr 27 15:15:39 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892" returned: 0 in 0.544s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b103fef8-58c4-4585-b95e-c15e04acaab2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bfcdea-8158-4295-8c4f-9de6832cad29]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:39 devstack sudo[89161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2
Apr 27 15:15:39 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:39 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-279609e9-fc62-496f-b719-378996769c9d 1073741824" returned: 0 in 0.601s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-279609e9-fc62-496f-b719-378996769c9d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:39 devstack sudo[89163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-279609e9-fc62-496f-b719-378996769c9d
Apr 27 15:15:39 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:40 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2" returned: 0 in 0.598s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:40 devstack sudo[89169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892
Apr 27 15:15:40 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:40 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-279609e9-fc62-496f-b719-378996769c9d" returned: 0 in 0.523s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.135s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] Creating offline snapshot d38c60d7-64ee-43fc-998d-745102887ab3 of volume 2fd3b796-7032-47a8-8957-10e5360ec676 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d4d10e-ec99-476e-8c96-bc59210a28fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279609e9-fc62-496f-b719-378996769c9d', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079f9ecb-1a96-4fd4-b828-69c6e38bbe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8930bf69-c168-4928-86f8-47e56b049ec6]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:40 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Volume volume-279609e9-fc62-496f-b719-378996769c9d (279609e9-fc62-496f-b719-378996769c9d): created successfully
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079f9ecb-1a96-4fd4-b828-69c6e38bbe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Flow 'volume_create_manager' (cf915ab9-0fdf-48e5-95f3-fce91f7acea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:40 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-0dd95ebc-5ffa-4dc2-9c5b-41f13aea396e tempest-VolumesGetTest-1914569613 None] Created volume successfully.
Apr 27 15:15:40 devstack sudo[89171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676
Apr 27 15:15:40 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:40 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892" returned: 0 in 0.520s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:40 devstack sudo[89176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892
Apr 27 15:15:40 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:41 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676" returned: 0 in 0.556s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:41 devstack sudo[89181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3 1G
Apr 27 15:15:41 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:41 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2.954dd733-be51-4f92-8990-49facb451892" returned: 0 in 0.469s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-954dd733-be51-4f92-8990-49facb451892" released by "_delete_snapshot" :: held 2.230s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-b103fef8-58c4-4585-b95e-c15e04acaab2" released by "delete_snapshot" :: held 2.256s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:41 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Created reservations ['5535b781-3870-448e-8673-db4e15f4b220', '2ec46ecf-2467-4e80-8cb3-bafda953c6ea', 'e384c46f-3d60-45c2-bbba-f735a3438cd1', 'a3d0245f-2e00-4210-9d78-3c80eaeeb5e6'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:15:41 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Delete snapshot completed successfully.
Apr 27 15:15:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-bb97637d-9a55-458d-8c7c-1da590e41e22 tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-954dd733-be51-4f92-8990-49facb451892-delete_snapshot" released by "delete_snapshot" :: held 2.416s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:41 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3 1G" returned: 0 in 0.663s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd3b796-7032-47a8-8957-10e5360ec676 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:41 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd3b796-7032-47a8-8957-10e5360ec676 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3
Apr 27 15:15:41 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:41 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:15:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Flow 'volume_create_manager' (9e15737d-05f9-4c43-bac0-c35d311fbb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b1c57b-711f-4601-9fcc-85aeec63d03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b1c57b-711f-4601-9fcc-85aeec63d03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-235240642',display_name='tempest-VolumesGetTest-Volume-991786592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e63eed8-d4e8-4401-898c-d15916dffd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92152e044e9542b19af465690dddcc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:42Z,use_quota=True,user_id='e32c49961c37419dbab449edec51198d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70df7eea-cc70-416a-97c2-78d522f86e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70df7eea-cc70-416a-97c2-78d522f86e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957bc133-91aa-44a5-ad3e-640969513ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957bc133-91aa-44a5-ad3e-640969513ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e63eed8-d4e8-4401-898c-d15916dffd66', 'volume_name': 'volume-9e63eed8-d4e8-4401-898c-d15916dffd66', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d579a6-3998-4f95-9b98-9cce2981cac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d579a6-3998-4f95-9b98-9cce2981cac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fcaf6b-8428-45a2-9eaf-e08bb26577d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:42 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Volume 9e63eed8-d4e8-4401-898c-d15916dffd66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e63eed8-d4e8-4401-898c-d15916dffd66', 'volume_size': 1}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:42 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd3b796-7032-47a8-8957-10e5360ec676 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3" returned: 0 in 0.568s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:42 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3 is being set with open permissions: ugo+rw
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-b103fef8-58c4-4585-b95e-c15e04acaab2-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:42 devstack sudo[89192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3
Apr 27 15:15:42 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-b103fef8-58c4-4585-b95e-c15e04acaab2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-quobyte-b103fef8-58c4-4585-b95e-c15e04acaab2" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-b103fef8-58c4-4585-b95e-c15e04acaab2" acquired by "delete_volume" :: waited 0.014s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a3c659-838e-4d80-8163-b4d918fb3c5e]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:42 devstack sudo[89194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2
Apr 27 15:15:42 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:42 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3" returned: 0 in 0.477s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:42 devstack sudo[89197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.info
Apr 27 15:15:42 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:42 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2" returned: 0 in 0.526s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:42 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2
Apr 27 15:15:42 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:43 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.info" returned: 0 in 0.449s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:43 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.info is being set with open permissions: ugo+rw
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:43 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.info
Apr 27 15:15:43 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:43 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b103fef8-58c4-4585-b95e-c15e04acaab2" returned: 0 in 0.453s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-b103fef8-58c4-4585-b95e-c15e04acaab2" released by "delete_volume" :: held 1.037s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Created reservations ['661e4c75-d659-432e-bc88-fa930baf5822', 'b3f3e6f1-cf8d-42d1-ba61-5c73d5019626', 'b6c51b8f-80bf-4666-a22c-a31426251943', '06e8dbe2-3290-4548-a53d-035c9a7f44f9'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:43 devstack sudo[89208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:15:43 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:43 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.info" returned: 0 in 0.471s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.275s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.649s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-235240642',display_name='tempest-VolumesGetTest-Volume-991786592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e63eed8-d4e8-4401-898c-d15916dffd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92152e044e9542b19af465690dddcc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:42Z,use_quota=True,user_id='e32c49961c37419dbab449edec51198d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Creating volume 9e63eed8-d4e8-4401-898c-d15916dffd66 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:15:43 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9e63eed8-d4e8-4401-898c-d15916dffd66 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:43 devstack sudo[89211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9e63eed8-d4e8-4401-898c-d15916dffd66 1073741824
Apr 27 15:15:43 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:43 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-d1f28ded-00f7-4a53-a21b-16e0352aa5cc tempest-VolumesExtendTest-544272695 None] Create snapshot completed successfully
Apr 27 15:15:43 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.437s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:15:43 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Deleted volume successfully.
Apr 27 15:15:43 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-4a965dd6-d982-422d-8f74-eeb61a4b2675 tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-b103fef8-58c4-4585-b95e-c15e04acaab2-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:44 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9e63eed8-d4e8-4401-898c-d15916dffd66 1073741824" returned: 0 in 0.603s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9e63eed8-d4e8-4401-898c-d15916dffd66 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:44 devstack sudo[89217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9e63eed8-d4e8-4401-898c-d15916dffd66
Apr 27 15:15:44 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b1177e33-66b6-4d4a-bc68-78ca391b3127 tempest-VolumesExtendTest-544272695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Flow 'volume_create_manager' (02f85360-25b6-4840-8518-89b105c50af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:44 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8d76df-3804-408b-9fa6-4a1e95f63d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9e63eed8-d4e8-4401-898c-d15916dffd66" returned: 0 in 0.506s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b1177e33-66b6-4d4a-bc68-78ca391b3127 tempest-VolumesExtendTest-544272695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.270s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8d76df-3804-408b-9fa6-4a1e95f63d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-360537976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba819dab27844aca899796396b5feaf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:45Z,use_quota=True,user_id='36e682f6f47b405f8bd5e51fc9f15285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd28bbff-abd6-4543-8cba-4a9de946a3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd28bbff-abd6-4543-8cba-4a9de946a3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a19dce-5b54-4cf2-b147-2b95073b46c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a19dce-5b54-4cf2-b147-2b95073b46c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce', 'volume_name': 'volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378b1148-0b64-47b8-83a6-75437771c26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378b1148-0b64-47b8-83a6-75437771c26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df7462e-67aa-49d3-a907-4a9f0ac378f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:44 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Volume a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce', 'volume_size': 1}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[17190f7f-9a2a-48e6-a28a-47da07091f48]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1177e33-66b6-4d4a-bc68-78ca391b3127 tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fcaf6b-8428-45a2-9eaf-e08bb26577d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e63eed8-d4e8-4401-898c-d15916dffd66', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b54ffe-8c6c-4179-a718-450630cf2bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:44 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Volume volume-9e63eed8-d4e8-4401-898c-d15916dffd66 (9e63eed8-d4e8-4401-898c-d15916dffd66): created successfully
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b54ffe-8c6c-4179-a718-450630cf2bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:44 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Flow 'volume_create_manager' (9e15737d-05f9-4c43-bac0-c35d311fbb08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:44 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5894bec1-0cb5-40ef-94a1-1dce6234bd4d tempest-VolumesGetTest-1914569613 None] Created volume successfully.
Apr 27 15:15:44 devstack sudo[89220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676
Apr 27 15:15:44 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-9e63eed8-d4e8-4401-898c-d15916dffd66-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Lock "cinder-9e63eed8-d4e8-4401-898c-d15916dffd66-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-quobyte-9e63eed8-d4e8-4401-898c-d15916dffd66" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-9e63eed8-d4e8-4401-898c-d15916dffd66" acquired by "delete_volume" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a327dac-a1cf-4388-aace-5468b01fee1d]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9e63eed8-d4e8-4401-898c-d15916dffd66 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:45 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1177e33-66b6-4d4a-bc68-78ca391b3127 tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676" returned: 0 in 0.576s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:45 devstack sudo[89225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9e63eed8-d4e8-4401-898c-d15916dffd66
Apr 27 15:15:45 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1177e33-66b6-4d4a-bc68-78ca391b3127 tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3 2G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1177e33-66b6-4d4a-bc68-78ca391b3127 tempest-VolumesExtendTest-544272695 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3 2G" returned: 0 in 0.169s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b1177e33-66b6-4d4a-bc68-78ca391b3127 tempest-VolumesExtendTest-544272695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.803s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-360537976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba819dab27844aca899796396b5feaf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:45Z,use_quota=True,user_id='36e682f6f47b405f8bd5e51fc9f15285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Creating volume a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:15:45 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:45 devstack sudo[89230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce 1073741824
Apr 27 15:15:45 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:45 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b1177e33-66b6-4d4a-bc68-78ca391b3127 tempest-VolumesExtendTest-544272695 None] Extend volume completed successfully.
Apr 27 15:15:45 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9e63eed8-d4e8-4401-898c-d15916dffd66" returned: 0 in 0.567s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9e63eed8-d4e8-4401-898c-d15916dffd66 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:45 devstack sudo[89235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9e63eed8-d4e8-4401-898c-d15916dffd66
Apr 27 15:15:45 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:46 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce 1073741824" returned: 0 in 0.611s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:46 devstack sudo[89241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce
Apr 27 15:15:46 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:46 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9e63eed8-d4e8-4401-898c-d15916dffd66" returned: 0 in 0.487s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-9e63eed8-d4e8-4401-898c-d15916dffd66" released by "delete_volume" :: held 1.092s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Created reservations ['103e7092-a6c1-4b8f-90b4-c9dc01b96521', '3b89a464-9cef-4159-9dc7-94f5d598ff4f', 'bae1fd76-60eb-4bab-b48c-6d3dc58da709', '2342c0f7-0e4f-4c3d-a7cf-17e886939421'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:46 devstack sudo[89243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:15:46 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:46 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce" returned: 0 in 0.449s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df7462e-67aa-49d3-a907-4a9f0ac378f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cccf0b95-b81f-40cd-acdf-286fc3e2a6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:46 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Volume volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce (a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce): created successfully
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cccf0b95-b81f-40cd-acdf-286fc3e2a6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Flow 'volume_create_manager' (02f85360-25b6-4840-8518-89b105c50af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Acquiring lock "cinder-d38c60d7-64ee-43fc-998d-745102887ab3-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:46 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-0fcfbdde-b23d-4a01-8d2e-fbcbc62a8e8e tempest-VolumeDependencyTests-2096246084 None] Created volume successfully.
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Lock "cinder-d38c60d7-64ee-43fc-998d-745102887ab3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Acquiring lock "cinder-quobyte-2fd3b796-7032-47a8-8957-10e5360ec676" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Lock "cinder-quobyte-2fd3b796-7032-47a8-8957-10e5360ec676" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Acquiring lock "cinder-quobyte-d38c60d7-64ee-43fc-998d-745102887ab3" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Lock "cinder-quobyte-d38c60d7-64ee-43fc-998d-745102887ab3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Deleting offline snapshot d38c60d7-64ee-43fc-998d-745102887ab3 of volume 2fd3b796-7032-47a8-8957-10e5360ec676 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] snapshot_file for this snap is: volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5606a695-967e-4660-996a-064bd6884fad]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:47 devstack sudo[89246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3
Apr 27 15:15:47 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:47 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.508s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:47 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:15:47 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Deleted volume successfully.
Apr 27 15:15:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-be7bce5c-dd37-4647-883a-a63ba28d7d67 tempest-VolumesGetTest-1914569613 None] Lock "cinder-9e63eed8-d4e8-4401-898c-d15916dffd66-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:47 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3" returned: 0 in 0.512s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:47 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fd3b796-7032-47a8-8957-10e5360ec676(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:15:47 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9121dc-95db-4a20-bc2f-8fea7609f5a4]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-279609e9-fc62-496f-b719-378996769c9d-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Lock "cinder-279609e9-fc62-496f-b719-378996769c9d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:47 devstack sudo[89252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676
Apr 27 15:15:47 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-quobyte-279609e9-fc62-496f-b719-378996769c9d" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-279609e9-fc62-496f-b719-378996769c9d" acquired by "delete_volume" :: waited 0.016s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:47 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbb0d61-c459-41f6-9c69-4e8431f8d66d]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-279609e9-fc62-496f-b719-378996769c9d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:47 devstack sudo[89254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-279609e9-fc62-496f-b719-378996769c9d
Apr 27 15:15:47 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:48 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676" returned: 0 in 0.564s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:48 devstack sudo[89259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3
Apr 27 15:15:48 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:48 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-279609e9-fc62-496f-b719-378996769c9d" returned: 0 in 0.581s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-279609e9-fc62-496f-b719-378996769c9d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:48 devstack sudo[89264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-279609e9-fc62-496f-b719-378996769c9d
Apr 27 15:15:48 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Flow 'volume_create_manager' (19c3792f-a7d1-4956-a4f9-1f78c473246e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b248ce-b31e-412f-b8e4-9957b4ceb020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b248ce-b31e-412f-b8e4-9957b4ceb020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1223375576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87ef2aa-5311-4c69-8034-07007265637f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba819dab27844aca899796396b5feaf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:48Z,use_quota=True,user_id='36e682f6f47b405f8bd5e51fc9f15285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae533989-906a-457e-bde3-4f1676b18cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae533989-906a-457e-bde3-4f1676b18cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c990159-43f2-4c87-adc0-9a8f08a5ca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c990159-43f2-4c87-adc0-9a8f08a5ca41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd87ef2aa-5311-4c69-8034-07007265637f', 'volume_name': 'volume-d87ef2aa-5311-4c69-8034-07007265637f', 'volume_size': 1, 'source_volid': 'a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce', 'source_volstatus': 'available'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb0e28c-2b4a-441e-aa2f-b35516edc1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb0e28c-2b4a-441e-aa2f-b35516edc1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a15766-bf7e-4f7e-87bd-c7d3dc2f3e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:48 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Volume d87ef2aa-5311-4c69-8034-07007265637f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d87ef2aa-5311-4c69-8034-07007265637f', 'volume_size': 1, 'source_volid': 'a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce', 'source_volstatus': 'available'}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:48 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Cloning volume a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce to volume d87ef2aa-5311-4c69-8034-07007265637f
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Creating offline snapshot f4a8be00-c1af-49d9-b17b-59aeb625acde of volume a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6d7ec9-0c8b-4b92-844a-bf63831fdfc5]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:48 devstack sudo[89267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce
Apr 27 15:15:48 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:48 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3" returned: 0 in 0.648s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:48 devstack sudo[89273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3
Apr 27 15:15:48 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:48 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-279609e9-fc62-496f-b719-378996769c9d" returned: 0 in 0.535s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-279609e9-fc62-496f-b719-378996769c9d" released by "delete_volume" :: held 1.154s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Created reservations ['4b720d21-bb8f-4b3d-9e7e-87d7786f3c83', 'b7c137bd-0a34-488f-a537-02802edfbfc9', 'd0c5d12d-5e0c-4608-a5ca-0ac4444930eb', 'd3f32477-5709-4c1e-984e-09646a61ba2e'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_service.periodic_task [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81538) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:48 devstack sudo[89275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:15:48 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:48 devstack sudo[89277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:15:48 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:49 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce" returned: 0 in 0.629s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:49 devstack sudo[89283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde 1G
Apr 27 15:15:49 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:49 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676.d38c60d7-64ee-43fc-998d-745102887ab3" returned: 0 in 0.483s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Lock "cinder-quobyte-d38c60d7-64ee-43fc-998d-745102887ab3" released by "_delete_snapshot" :: held 2.312s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Lock "cinder-quobyte-2fd3b796-7032-47a8-8957-10e5360ec676" released by "delete_snapshot" :: held 2.334s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:49 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Created reservations ['e2ef00ad-f7a8-425c-9e92-197124931038', '8a64c52f-5b47-434a-ae51-80cae7912a14', 'b2c59f70-39ec-4b31-a609-28b264aa3687', 'bd920ad5-1d9d-40dd-9c88-6a94239f30e4'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:15:49 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Delete snapshot completed successfully.
Apr 27 15:15:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-fdfc5f90-11ee-49da-b12e-0d6f637aa15e tempest-VolumesExtendTest-544272695 None] Lock "cinder-d38c60d7-64ee-43fc-998d-745102887ab3-delete_snapshot" released by "delete_snapshot" :: held 2.484s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:49 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.563s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:49 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:15:49 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.527s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:49 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:15:49 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Deleted volume successfully.
Apr 27 15:15:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-40d0d6a3-6f69-44f7-aea8-fad251df0813 tempest-VolumesGetTest-1914569613 None] Lock "cinder-279609e9-fc62-496f-b719-378996769c9d-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:49 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde 1G" returned: 0 in 0.644s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:49 devstack sudo[89290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde
Apr 27 15:15:49 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Flow 'volume_create_manager' (34d7d9b4-25a1-40f1-bdc0-3eb5fba83828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb5ebde-5ad2-4ea0-b684-040c92715ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb5ebde-5ad2-4ea0-b684-040c92715ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-417461121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a4e1db-351a-4e03-94de-c061d577276d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92152e044e9542b19af465690dddcc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:50Z,use_quota=True,user_id='e32c49961c37419dbab449edec51198d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69087625-4fa3-49e1-aeab-2bb88d73693a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69087625-4fa3-49e1-aeab-2bb88d73693a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa0078b-aa26-4f76-8d48-80ca932de5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa0078b-aa26-4f76-8d48-80ca932de5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a4e1db-351a-4e03-94de-c061d577276d', 'volume_name': 'volume-a8a4e1db-351a-4e03-94de-c061d577276d', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c8928e-1380-4455-acd2-4f8a278ec644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c8928e-1380-4455-acd2-4f8a278ec644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b729f5fe-a433-4bb7-a022-91dd89ee17fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:50 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Volume a8a4e1db-351a-4e03-94de-c061d577276d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a4e1db-351a-4e03-94de-c061d577276d', 'volume_size': 1}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Acquiring lock "cinder-2fd3b796-7032-47a8-8957-10e5360ec676-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Lock "cinder-2fd3b796-7032-47a8-8957-10e5360ec676-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Acquiring lock "cinder-quobyte-2fd3b796-7032-47a8-8957-10e5360ec676" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Lock "cinder-quobyte-2fd3b796-7032-47a8-8957-10e5360ec676" acquired by "delete_volume" :: waited 0.014s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a28738f-db1c-484e-b32e-920e10d12f7d]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:50 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde" returned: 0 in 0.549s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:50 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde is being set with open permissions: ugo+rw
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:50 devstack sudo[89296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde
Apr 27 15:15:50 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:50 devstack sudo[89295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676
Apr 27 15:15:50 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:50 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde" returned: 0 in 0.442s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:50 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676" returned: 0 in 0.504s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:50 devstack sudo[89303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676
Apr 27 15:15:50 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:50 devstack sudo[89304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.info
Apr 27 15:15:50 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:51 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-2fd3b796-7032-47a8-8957-10e5360ec676" returned: 0 in 0.482s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:51 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.info" returned: 0 in 0.503s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:51 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.info is being set with open permissions: ugo+rw
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Lock "cinder-quobyte-2fd3b796-7032-47a8-8957-10e5360ec676" released by "delete_volume" :: held 1.074s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:51 devstack sudo[89309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.info
Apr 27 15:15:51 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Created reservations ['93082108-f87e-4ae8-babf-4cf19e494bea', '5d566b80-80f5-4ace-9b42-ff23812ea6ba', 'aec32113-37bd-4dd7-91e9-6e610fb52ac0', 'c935ff23-4e98-4b86-b4f0-aa8aa51d839e'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:51 devstack sudo[89312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:15:51 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:51 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.info" returned: 0 in 0.459s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-quobyte-d87ef2aa-5311-4c69-8034-07007265637f" by "_copy_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-d87ef2aa-5311-4c69-8034-07007265637f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] snapshot: f4a8be00-c1af-49d9-b17b-59aeb625acde, volume: d87ef2aa-5311-4c69-8034-07007265637f,  {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcd4981-930d-4199-a3ae-5fda2c915952]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:51 devstack sudo[89315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde
Apr 27 15:15:51 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:51 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.463s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:15:51 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Deleted volume successfully.
Apr 27 15:15:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-95730b03-8eb6-44bc-b7bf-6c3ab7065d6a tempest-VolumesExtendTest-544272695 None] Lock "cinder-2fd3b796-7032-47a8-8957-10e5360ec676-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:52 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde" returned: 0 in 0.552s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:15:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 27 15:15:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Creating direct copy from snapshot {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 27 15:15:52 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[239801b8-6603-4012-9739-d9c85069da1d]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:52 devstack sudo[89321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce
Apr 27 15:15:52 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:53 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce" returned: 0 in 0.665s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:53 devstack cinder-volume[81538]: DEBUG cinder.utils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Path /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f not found in is_blk_device check {{(pid=81538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 27 15:15:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:53 devstack sudo[89326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f
Apr 27 15:15:53 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:56 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:15:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Flow 'volume_create_manager' (4a6bd44e-f600-44a4-941d-a70d604ad464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:15:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c3a0c6-1b31-40ed-8ffb-ef6fb649959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c3a0c6-1b31-40ed-8ffb-ef6fb649959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-321968551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef6157f-21de-4bda-8e92-7cbe9223dda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c5d2d6b6c7d46da9f6e13d5ecde2613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:56Z,use_quota=True,user_id='0d3466fd22be4984bcf60195373af3b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f6faa2-392a-4a35-9425-cea0e34e7209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f6faa2-392a-4a35-9425-cea0e34e7209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9ceb63-4377-40ac-b9d9-a43d073e8e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9ceb63-4377-40ac-b9d9-a43d073e8e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef6157f-21de-4bda-8e92-7cbe9223dda4', 'volume_name': 'volume-fef6157f-21de-4bda-8e92-7cbe9223dda4', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18a9027-5a5a-4505-b833-5104f5615b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18a9027-5a5a-4505-b833-5104f5615b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:15:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9ea504-b879-4c26-ad61-a27fd39498c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:15:56 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Volume fef6157f-21de-4bda-8e92-7cbe9223dda4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef6157f-21de-4bda-8e92-7cbe9223dda4', 'volume_size': 1}
Apr 27 15:15:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:15:58 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f" returned: 0 in 5.158s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:58 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aee5cf2-05a8-4c9c-ba3e-adaf8b89d56f]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:58 devstack sudo[89341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce
Apr 27 15:15:58 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:58 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce" returned: 0 in 0.632s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:58 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:15:58 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Converted 1024.00 MB image at 198.49 MB/s
Apr 27 15:15:58 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f is being set with open permissions: ugo+rw
Apr 27 15:15:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:58 devstack sudo[89347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f
Apr 27 15:15:58 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:59 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f" returned: 0 in 0.420s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-d87ef2aa-5311-4c69-8034-07007265637f" released by "_copy_volume_from_snapshot" :: held 7.506s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:15:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-quobyte-f4a8be00-c1af-49d9-b17b-59aeb625acde" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:15:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-f4a8be00-c1af-49d9-b17b-59aeb625acde" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:15:59 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Deleting offline snapshot f4a8be00-c1af-49d9-b17b-59aeb625acde of volume a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:15:59 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] snapshot_file for this snap is: volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:15:59 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfbc2da-58a3-46f3-b480-f5954636184b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:59 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde
Apr 27 15:15:59 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:15:59 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 27 15:15:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde" returned: 0 in 0.509s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:15:59 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:15:59 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aec836-a4f5-4b22-9506-1fa066bbd1e1]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:15:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:15:59 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce
Apr 27 15:15:59 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:00 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce" returned: 0 in 0.518s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:00 devstack sudo[89394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde
Apr 27 15:16:00 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:00 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde" returned: 0 in 0.520s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:00 devstack sudo[89399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde
Apr 27 15:16:00 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:01 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce.f4a8be00-c1af-49d9-b17b-59aeb625acde" returned: 0 in 0.435s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-f4a8be00-c1af-49d9-b17b-59aeb625acde" released by "_delete_snapshot" :: held 2.072s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.981s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.282s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-417461121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a4e1db-351a-4e03-94de-c061d577276d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92152e044e9542b19af465690dddcc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:50Z,use_quota=True,user_id='e32c49961c37419dbab449edec51198d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Creating volume a8a4e1db-351a-4e03-94de-c061d577276d {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:16:01 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a15766-bf7e-4f7e-87bd-c7d3dc2f3e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87ef2aa-5311-4c69-8034-07007265637f', 'volume_size': 1, 'source_volid': 'a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce', 'source_volstatus': 'available'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9086d2af-f677-4438-ad46-5e2f7d993442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:01 devstack sudo[89402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d 1073741824
Apr 27 15:16:01 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:01 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Volume volume-d87ef2aa-5311-4c69-8034-07007265637f (d87ef2aa-5311-4c69-8034-07007265637f): created successfully
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9086d2af-f677-4438-ad46-5e2f7d993442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Flow 'volume_create_manager' (19c3792f-a7d1-4956-a4f9-1f78c473246e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:01 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-3d7114ae-dd33-41e2-b61c-3a1169cbe3fe tempest-VolumeDependencyTests-2096246084 None] Created volume successfully.
Apr 27 15:16:02 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d 1073741824" returned: 0 in 0.602s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:02 devstack sudo[89408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d
Apr 27 15:16:02 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-quobyte-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bdd4b3-2227-40c8-960b-59fb992b6fbd]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:02 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d" returned: 0 in 0.496s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.221s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-321968551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef6157f-21de-4bda-8e92-7cbe9223dda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c5d2d6b6c7d46da9f6e13d5ecde2613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:15:56Z,use_quota=True,user_id='0d3466fd22be4984bcf60195373af3b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Creating volume fef6157f-21de-4bda-8e92-7cbe9223dda4 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:16:02 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fef6157f-21de-4bda-8e92-7cbe9223dda4 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:02 devstack sudo[89412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fef6157f-21de-4bda-8e92-7cbe9223dda4 1073741824
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b729f5fe-a433-4bb7-a022-91dd89ee17fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a4e1db-351a-4e03-94de-c061d577276d', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:02 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac49bdb-3912-452c-8494-42480f1d8956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:02 devstack sudo[89411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce
Apr 27 15:16:02 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:02 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Volume volume-a8a4e1db-351a-4e03-94de-c061d577276d (a8a4e1db-351a-4e03-94de-c061d577276d): created successfully
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac49bdb-3912-452c-8494-42480f1d8956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Flow 'volume_create_manager' (34d7d9b4-25a1-40f1-bdc0-3eb5fba83828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:02 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-c470a05e-3b59-4aee-93e2-6a1c8c7e2600 tempest-VolumesGetTest-1914569613 None] Created volume successfully.
Apr 27 15:16:03 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce" returned: 0 in 0.597s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:03 devstack sudo[89421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce
Apr 27 15:16:03 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:03 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fef6157f-21de-4bda-8e92-7cbe9223dda4 1073741824" returned: 0 in 0.714s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fef6157f-21de-4bda-8e92-7cbe9223dda4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:03 devstack sudo[89423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fef6157f-21de-4bda-8e92-7cbe9223dda4
Apr 27 15:16:03 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Flow 'volume_create_manager' (ec230a67-2bcd-4889-a547-5d6c30c26a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c506ea09-c3e4-4192-bf28-ffaeecc110a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c506ea09-c3e4-4192-bf28-ffaeecc110a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-237277073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a7c02e-1604-4482-bab3-b5e2b48a89b6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='92152e044e9542b19af465690dddcc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=a8a4e1db-351a-4e03-94de-c061d577276d,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:03Z,use_quota=True,user_id='e32c49961c37419dbab449edec51198d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16837a9b-7892-46da-acee-bdb4b26c145b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16837a9b-7892-46da-acee-bdb4b26c145b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8c5917-970d-4d43-afe6-76fcf899186f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8c5917-970d-4d43-afe6-76fcf899186f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '35a7c02e-1604-4482-bab3-b5e2b48a89b6', 'volume_name': 'volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6', 'volume_size': 1, 'source_volid': 'a8a4e1db-351a-4e03-94de-c061d577276d', 'source_volstatus': 'available'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3faed4e-d118-487c-8326-1cd1989ad780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3faed4e-d118-487c-8326-1cd1989ad780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b214070-07f7-4ccd-867f-f6d4d4bf1642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:03 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Volume 35a7c02e-1604-4482-bab3-b5e2b48a89b6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6', 'volume_size': 1, 'source_volid': 'a8a4e1db-351a-4e03-94de-c061d577276d', 'source_volstatus': 'available'}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:03 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce" returned: 0 in 0.528s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce" released by "delete_volume" :: held 1.187s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Created reservations ['97a0a6ba-a896-419b-ae53-ef0c16a16e8a', '371051f2-c9e7-41b3-8371-7324283d479b', 'a9eb606a-0b4e-453f-ad9f-18bc777011bc', '16fcb98d-694c-418b-b355-29fb56a9dcde'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:03 devstack sudo[89427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:16:03 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:03 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fef6157f-21de-4bda-8e92-7cbe9223dda4" returned: 0 in 0.490s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.312s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:03 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Cloning volume a8a4e1db-351a-4e03-94de-c061d577276d to volume 35a7c02e-1604-4482-bab3-b5e2b48a89b6
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9ea504-b879-4c26-ad61-a27fd39498c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef6157f-21de-4bda-8e92-7cbe9223dda4', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4262caa-a420-46e5-8688-b76fad4a505b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:03 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Volume volume-fef6157f-21de-4bda-8e92-7cbe9223dda4 (fef6157f-21de-4bda-8e92-7cbe9223dda4): created successfully
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4262caa-a420-46e5-8688-b76fad4a505b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Flow 'volume_create_manager' (4a6bd44e-f600-44a4-941d-a70d604ad464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Creating offline snapshot b36c9943-9dff-4ad9-8253-1eb8f6599b77 of volume a8a4e1db-351a-4e03-94de-c061d577276d {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:16:03 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ca34ece3-1383-4e52-81bf-fd80c1339024 tempest-VolumesNegativeTest-370674646 None] Created volume successfully.
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d51082b-a930-4e81-9a1d-7f4782ad237e]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:03 devstack sudo[89429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d
Apr 27 15:16:03 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:04 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.464s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:04 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:16:04 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Deleted volume successfully.
Apr 27 15:16:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1c3383c7-376c-4a47-a000-72e49bb6fc7b tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-a11aa78a-b1b0-464c-a0c6-ef1d92ba24ce-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:04 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d" returned: 0 in 0.536s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:04 devstack sudo[89435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77 1G
Apr 27 15:16:04 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-d87ef2aa-5311-4c69-8034-07007265637f-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-d87ef2aa-5311-4c69-8034-07007265637f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-quobyte-d87ef2aa-5311-4c69-8034-07007265637f" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-d87ef2aa-5311-4c69-8034-07007265637f" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:04 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[292a3a8f-8da6-4161-89f2-42efa5f4154b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:04 devstack sudo[89437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f
Apr 27 15:16:04 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:05 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77 1G" returned: 0 in 0.650s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a4e1db-351a-4e03-94de-c061d577276d -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:05 devstack sudo[89442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a4e1db-351a-4e03-94de-c061d577276d -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77
Apr 27 15:16:05 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:05 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f" returned: 0 in 0.613s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:05 devstack sudo[89450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f
Apr 27 15:16:05 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:05 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a4e1db-351a-4e03-94de-c061d577276d -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77" returned: 0 in 0.541s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:05 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77 is being set with open permissions: ugo+rw
Apr 27 15:16:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:05 devstack sudo[89455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77
Apr 27 15:16:05 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:05 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d87ef2aa-5311-4c69-8034-07007265637f" returned: 0 in 0.507s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-d87ef2aa-5311-4c69-8034-07007265637f" released by "delete_volume" :: held 1.162s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:05 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Created reservations ['447a8d12-6f60-4160-a468-4e9ffa6e8a1b', '4720ada9-180b-4697-9596-1a53ce7763f8', 'b4567dcb-4b78-4458-817d-c68cb596f94b', '89083147-cf01-4aa3-9f0c-34218d6d88ac'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:16:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:05 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:06 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:06 devstack sudo[89459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:16:06 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:06 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77" returned: 0 in 0.518s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:06 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.info
Apr 27 15:16:06 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:06 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.471s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:06 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:16:06 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Deleted volume successfully.
Apr 27 15:16:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-688ecd52-fc90-4ed1-b62e-88895b3fb64a tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-d87ef2aa-5311-4c69-8034-07007265637f-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:06 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.info" returned: 0 in 0.475s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:06 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.info is being set with open permissions: ugo+rw
Apr 27 15:16:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:06 devstack sudo[89466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.info
Apr 27 15:16:06 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-cfa562f8-36ce-4434-937c-c4504b363554-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-cfa562f8-36ce-4434-937c-c4504b363554-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "cinder-quobyte-cfa562f8-36ce-4434-937c-c4504b363554" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-cfa562f8-36ce-4434-937c-c4504b363554" acquired by "delete_volume" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bd0bc6-5d8f-4886-a175-cd540499e649]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:07 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:07 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554
Apr 27 15:16:07 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.info" returned: 0 in 0.482s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-quobyte-35a7c02e-1604-4482-bab3-b5e2b48a89b6" by "_copy_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-35a7c02e-1604-4482-bab3-b5e2b48a89b6" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] snapshot: b36c9943-9dff-4ad9-8253-1eb8f6599b77, volume: 35a7c02e-1604-4482-bab3-b5e2b48a89b6,  {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b773019-8a06-4228-ac07-0fc5a1159bd5]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:07 devstack sudo[89471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77
Apr 27 15:16:07 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:07 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554" returned: 0 in 0.595s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:07 devstack sudo[89478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554
Apr 27 15:16:07 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:07 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77" returned: 0 in 0.551s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8a4e1db-351a-4e03-94de-c061d577276d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Creating direct copy from snapshot {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4540afbd-2ba7-4cdc-b523-7da2d26a7e35]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:07 devstack sudo[89481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d
Apr 27 15:16:07 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:08 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-cfa562f8-36ce-4434-937c-c4504b363554" returned: 0 in 0.462s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-quobyte-cfa562f8-36ce-4434-937c-c4504b363554" released by "delete_volume" :: held 1.106s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Created reservations ['0357d978-9e53-430b-a760-0d4617fa8277', 'fccde826-ba27-4637-8d4e-e882cdc573e1', 'c19a9dd4-970b-4ef0-b7b8-d661429c2f20', 'fe1e64f5-4c99-4c84-83c0-76089bd87d61'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:08 devstack sudo[89487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:16:08 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:08 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d" returned: 0 in 0.547s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG cinder.utils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Path /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6 not found in is_blk_device check {{(pid=81538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:08 devstack sudo[89489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6
Apr 27 15:16:08 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:08 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.500s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:16:08 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Deleted volume successfully.
Apr 27 15:16:08 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-3656a137-a859-432c-8d2f-3728eca64e67 tempest-VolumeDependencyTests-2096246084 None] Lock "cinder-cfa562f8-36ce-4434-937c-c4504b363554-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:14 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6" returned: 0 in 6.386s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:14 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d383e12f-ea78-451b-b40b-dda420674a9b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:14 devstack sudo[89520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d
Apr 27 15:16:14 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:15 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d" returned: 0 in 0.648s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:15 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6 {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:16:15 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Converted 1024.00 MB image at 160.29 MB/s
Apr 27 15:16:15 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6 is being set with open permissions: ugo+rw
Apr 27 15:16:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:15 devstack sudo[89525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6
Apr 27 15:16:15 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:15 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6" returned: 0 in 0.439s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-35a7c02e-1604-4482-bab3-b5e2b48a89b6" released by "_copy_volume_from_snapshot" :: held 8.649s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:15 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:UPDATE=128,cinder:INSERT=33,cinder:SELECT=107,cinder:DELETE=13 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:16:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-quobyte-b36c9943-9dff-4ad9-8253-1eb8f6599b77" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-b36c9943-9dff-4ad9-8253-1eb8f6599b77" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Deleting offline snapshot b36c9943-9dff-4ad9-8253-1eb8f6599b77 of volume a8a4e1db-351a-4e03-94de-c061d577276d {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:16:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] snapshot_file for this snap is: volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:16:15 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6899df4b-e1b2-47b9-adc6-c03cb998353d]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:15 devstack sudo[89528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77
Apr 27 15:16:15 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:16 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77" returned: 0 in 0.577s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8a4e1db-351a-4e03-94de-c061d577276d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:16:16 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47bbee0-fc17-45ca-873d-701a50f90409]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:16 devstack sudo[89533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d
Apr 27 15:16:16 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:17 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d" returned: 0 in 0.527s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:17 devstack sudo[89538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77
Apr 27 15:16:17 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:17 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77" returned: 0 in 0.543s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:17 devstack sudo[89543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77
Apr 27 15:16:17 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:18 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d.b36c9943-9dff-4ad9-8253-1eb8f6599b77" returned: 0 in 0.456s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:18 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-b36c9943-9dff-4ad9-8253-1eb8f6599b77" released by "_delete_snapshot" :: held 2.203s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:18 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=95,cinder:UPDATE=123,cinder:INSERT=38,cinder:DELETE=8 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:16:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.267s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b214070-07f7-4ccd-867f-f6d4d4bf1642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6', 'volume_size': 1, 'source_volid': 'a8a4e1db-351a-4e03-94de-c061d577276d', 'source_volstatus': 'available'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ac3eeb-8d55-4da2-af52-f3de5c8d942c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:18 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Volume volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6 (35a7c02e-1604-4482-bab3-b5e2b48a89b6): created successfully
Apr 27 15:16:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ac3eeb-8d55-4da2-af52-f3de5c8d942c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Flow 'volume_create_manager' (ec230a67-2bcd-4889-a547-5d6c30c26a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:18 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-37ea2292-7a67-41e6-9ce3-2cf6b8d0ec3a tempest-VolumesGetTest-1914569613 None] Created volume successfully.
Apr 27 15:16:18 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:16:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Flow 'volume_create_manager' (2ada162f-3ce4-45a9-86eb-580cd1c7facc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:18 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bca655-aff8-404c-aa78-69a9bb775f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bca655-aff8-404c-aa78-69a9bb775f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-895845344',display_name='tempest-VolumesGetTest-Volume-1763222273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db92ace-63f1-4bbd-b351-e45f07cb9eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92152e044e9542b19af465690dddcc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:19Z,use_quota=True,user_id='e32c49961c37419dbab449edec51198d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf8301d-cf14-4b87-a258-8ad0688cdc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf8301d-cf14-4b87-a258-8ad0688cdc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1bdff9-cd42-4389-abfe-9db1d92684e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1bdff9-cd42-4389-abfe-9db1d92684e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db92ace-63f1-4bbd-b351-e45f07cb9eff', 'volume_name': 'volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9a0b91-e1f5-494b-8784-c24db816ee01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9a0b91-e1f5-494b-8784-c24db816ee01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b4f990-8d86-4414-841b-a164a3ab5532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:19 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Volume 4db92ace-63f1-4bbd-b351-e45f07cb9eff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff', 'volume_size': 1}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-895845344',display_name='tempest-VolumesGetTest-Volume-1763222273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db92ace-63f1-4bbd-b351-e45f07cb9eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92152e044e9542b19af465690dddcc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:19Z,use_quota=True,user_id='e32c49961c37419dbab449edec51198d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Creating volume 4db92ace-63f1-4bbd-b351-e45f07cb9eff {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:16:19 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:19 devstack sudo[89550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff 1073741824
Apr 27 15:16:19 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:19 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff 1073741824" returned: 0 in 0.630s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:19 devstack sudo[89561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff
Apr 27 15:16:19 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:20 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff" returned: 0 in 0.441s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:16:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b4f990-8d86-4414-841b-a164a3ab5532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe47501-e349-4581-a05c-5b2c887e497b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:20 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Volume volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff (4db92ace-63f1-4bbd-b351-e45f07cb9eff): created successfully
Apr 27 15:16:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe47501-e349-4581-a05c-5b2c887e497b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Flow 'volume_create_manager' (2ada162f-3ce4-45a9-86eb-580cd1c7facc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:20 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-bb179e07-3cc4-46a0-b5f8-fdad47eae7c9 tempest-VolumesGetTest-1914569613 None] Created volume successfully.
Apr 27 15:16:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-4db92ace-63f1-4bbd-b351-e45f07cb9eff-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Lock "cinder-4db92ace-63f1-4bbd-b351-e45f07cb9eff-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-quobyte-4db92ace-63f1-4bbd-b351-e45f07cb9eff" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:21 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-4db92ace-63f1-4bbd-b351-e45f07cb9eff" acquired by "delete_volume" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:21 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35e2652-0206-47e4-aeca-601c5f9b9e87]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:21 devstack sudo[89603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff
Apr 27 15:16:21 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:21 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff" returned: 0 in 0.579s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:22 devstack sudo[89609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff
Apr 27 15:16:22 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:22 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-4db92ace-63f1-4bbd-b351-e45f07cb9eff" returned: 0 in 0.470s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-4db92ace-63f1-4bbd-b351-e45f07cb9eff" released by "delete_volume" :: held 1.103s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:22 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Created reservations ['7477a5c7-8eb1-4177-9c31-d3014d8c663c', '517fd5c0-9ba0-4221-a9f4-1cbd815c1dae', '14300dac-2015-400b-9a1f-a5553fd0a1ba', '57fb0157-9f09-4471-831e-55eeadcc1510'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:16:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:22 devstack sudo[89612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:16:22 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:23 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.555s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:23 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:16:23 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Deleted volume successfully.
Apr 27 15:16:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-df68d52f-90ca-490d-b871-1e116de0e85c tempest-VolumesGetTest-1914569613 None] Lock "cinder-4db92ace-63f1-4bbd-b351-e45f07cb9eff-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-35a7c02e-1604-4482-bab3-b5e2b48a89b6-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Lock "cinder-35a7c02e-1604-4482-bab3-b5e2b48a89b6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-quobyte-35a7c02e-1604-4482-bab3-b5e2b48a89b6" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:23 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-35a7c02e-1604-4482-bab3-b5e2b48a89b6" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:23 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1671a4c-33cb-4ac7-91d7-f07e9afb4a9c]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:23 devstack sudo[89616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6
Apr 27 15:16:23 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:24 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6" returned: 0 in 0.540s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:24 devstack sudo[89621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6
Apr 27 15:16:24 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:24 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-35a7c02e-1604-4482-bab3-b5e2b48a89b6" returned: 0 in 0.607s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-35a7c02e-1604-4482-bab3-b5e2b48a89b6" released by "delete_volume" :: held 1.189s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:24 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Created reservations ['b90b2ef8-670e-4071-9703-d02e32562776', '11a5d0ea-2076-4e3f-9474-b60eb1eb7c30', 'a0548543-2c42-4e1d-887e-22f6d52276b4', 'fef374ed-55aa-4f4a-950f-ab5c7f55d680'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:16:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:25 devstack sudo[89654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:16:25 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:25 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.456s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:25 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:16:25 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Deleted volume successfully.
Apr 27 15:16:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1f099169-964b-4dce-94d6-1b9178a24948 tempest-VolumesGetTest-1914569613 None] Lock "cinder-35a7c02e-1604-4482-bab3-b5e2b48a89b6-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-a8a4e1db-351a-4e03-94de-c061d577276d-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Lock "cinder-a8a4e1db-351a-4e03-94de-c061d577276d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-quobyte-a8a4e1db-351a-4e03-94de-c061d577276d" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-a8a4e1db-351a-4e03-94de-c061d577276d" acquired by "delete_volume" :: waited 0.027s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:26 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d05f48-d0f4-4d64-9813-9a956750bd4c]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:26 devstack sudo[89658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d
Apr 27 15:16:26 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:26 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d" returned: 0 in 0.573s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:26 devstack sudo[89663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d
Apr 27 15:16:26 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:27 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8a4e1db-351a-4e03-94de-c061d577276d" returned: 0 in 0.508s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-a8a4e1db-351a-4e03-94de-c061d577276d" released by "delete_volume" :: held 1.152s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:27 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Created reservations ['ab95e0fc-00a9-4d15-80ac-9eddcd888e5d', '5a1c7db1-2115-400d-bd19-d84f210b3cfa', 'e34c1e4f-561b-4542-86b7-32ee52a2fa9e', '8fcc98f9-0927-49cf-a358-470a8e37a153'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:16:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:27 devstack sudo[89667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:16:27 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:27 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.440s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:27 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:16:27 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Deleted volume successfully.
Apr 27 15:16:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-baa3138f-e704-4702-95fd-bde864426a62 tempest-VolumesGetTest-1914569613 None] Lock "cinder-a8a4e1db-351a-4e03-94de-c061d577276d-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:28 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:16:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Flow 'volume_create_manager' (f2e4fe56-4734-4cfb-a704-bf963aefe950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c483173-b077-4a1d-b2b1-a27031cd34d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c483173-b077-4a1d-b2b1-a27031cd34d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1199321215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5c9d23-e47e-4739-8862-6b9712e6b22a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='92152e044e9542b19af465690dddcc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:29Z,use_quota=True,user_id='e32c49961c37419dbab449edec51198d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6608fb9-7e18-466a-9cc8-92d1dcce5b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6608fb9-7e18-466a-9cc8-92d1dcce5b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b13c03-98e2-4b0a-b306-9e8bcfde8237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:28 devstack cinder-volume[81538]: DEBUG cinder.image.glance [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Creating Keystone auth plugin from conf {{(pid=81538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 27 15:16:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b13c03-98e2-4b0a-b306-9e8bcfde8237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c5c9d23-e47e-4739-8862-6b9712e6b22a', 'volume_name': 'volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a', 'volume_size': 1, 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8b5f6f0ff7c46c9826225de4a824e37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17408032-d085-42b0-a4db-fa0192e428de', 'created_at': datetime.datetime(2026, 4, 27, 13, 1, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 13, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17408032-d085-42b0-a4db-fa0192e428de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f59e4d15090>}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2285159-e08f-49df-b68b-0492b25b5a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2285159-e08f-49df-b68b-0492b25b5a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1191a2ad-5d5c-4a21-8c61-f69d88c9cfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:29 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Volume 6c5c9d23-e47e-4739-8862-6b9712e6b22a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a', 'volume_size': 1, 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8b5f6f0ff7c46c9826225de4a824e37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17408032-d085-42b0-a4db-fa0192e428de', 'created_at': datetime.datetime(2026, 4, 27, 13, 1, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 13, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17408032-d085-42b0-a4db-fa0192e428de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f59e4d15090>}
Apr 27 15:16:29 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Trying to clone 6c5c9d23-e47e-4739-8862-6b9712e6b22a from image 17408032-d085-42b0-a4db-fa0192e428de at location (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]). {{(pid=81538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 27 15:16:29 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_mj6odt25devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81538) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 27 15:16:29 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Image download 20.69 MB at 20.69 MB/s
Apr 27 15:16:29 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2ec5a9-08f6-412c-ba56-a9d4f131058b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_mj6odt25devstack@QuobyteHD {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:29 devstack sudo[89672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_mj6odt25devstack@QuobyteHD
Apr 27 15:16:29 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:29 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_mj6odt25devstack@QuobyteHD" returned: 0 in 0.492s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:29 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Temporary image 17408032-d085-42b0-a4db-fa0192e428de is fetched for user e32c49961c37419dbab449edec51198d. {{(pid=81538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 27 15:16:30 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a960d063-2066-49f1-ac0a-aa1076eb7786]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_mj6odt25devstack@QuobyteHD {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:30 devstack sudo[89677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_mj6odt25devstack@QuobyteHD
Apr 27 15:16:30 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:30 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_mj6odt25devstack@QuobyteHD" returned: 0 in 0.497s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1199321215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5c9d23-e47e-4739-8862-6b9712e6b22a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='92152e044e9542b19af465690dddcc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:29Z,use_quota=True,user_id='e32c49961c37419dbab449edec51198d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:16:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Creating volume 6c5c9d23-e47e-4739-8862-6b9712e6b22a {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:16:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:30 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:16:30 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:16:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:30 devstack sudo[89682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a 1073741824
Apr 27 15:16:30 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:31 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a 1073741824" returned: 0 in 0.658s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:31 devstack sudo[89687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a
Apr 27 15:16:31 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:31 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a" returned: 0 in 0.479s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:16:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:31 devstack cinder-volume[81538]: DEBUG cinder.volume.volume_utils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Attempting download of 17408032-d085-42b0-a4db-fa0192e428de ((None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}])) to volume 6c5c9d23-e47e-4739-8862-6b9712e6b22a. {{(pid=81538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 27 15:16:31 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[19182a3a-b0c0-4bc2-9178-22ae4f5fba49]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_ijvmf1yq {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:31 devstack sudo[89690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_ijvmf1yq
Apr 27 15:16:31 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:32 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_ijvmf1yq" returned: 0 in 0.528s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_ijvmf1yq {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:32 devstack sudo[89695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_ijvmf1yq
Apr 27 15:16:32 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:32 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_ijvmf1yq" returned: 1 in 0.550s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_17408032-d085-42b0-a4db-fa0192e428de_ijvmf1yq' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:16:32 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9e15ab-6a4f-4f13-9257-1acf5e314289]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_mj6odt25devstack@QuobyteHD {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:32 devstack sudo[89700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_mj6odt25devstack@QuobyteHD
Apr 27 15:16:32 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:33 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_mj6odt25devstack@QuobyteHD" returned: 0 in 0.511s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:33 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] 17408032-d085-42b0-a4db-fa0192e428de was qcow2, converting to raw {{(pid=81538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 27 15:16:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_mj6odt25devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:33 devstack sudo[89705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_mj6odt25devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a
Apr 27 15:16:33 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:34 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_mj6odt25devstack@QuobyteHD /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a" returned: 0 in 1.353s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:34 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_17408032-d085-42b0-a4db-fa0192e428de_mj6odt25devstack@QuobyteHD, size 112.00 MB, duration 1.35 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:16:34 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Converted 112.00 MB image at 82.67 MB/s
Apr 27 15:16:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:34 devstack sudo[89723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a 1G
Apr 27 15:16:34 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:35 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a 1G" returned: 0 in 0.529s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:35 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1a275f-5d14-4b36-a607-d0b10d64d6a2]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:35 devstack sudo[89728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a
Apr 27 15:16:35 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:35 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a" returned: 0 in 0.520s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Acquiring lock "cinder-fef6157f-21de-4bda-8e92-7cbe9223dda4-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Lock "cinder-fef6157f-21de-4bda-8e92-7cbe9223dda4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:35 devstack sudo[89732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a
Apr 27 15:16:35 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Acquiring lock "cinder-quobyte-fef6157f-21de-4bda-8e92-7cbe9223dda4" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Lock "cinder-quobyte-fef6157f-21de-4bda-8e92-7cbe9223dda4" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:35 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7998bf03-322c-4665-9259-3720ee07c74c]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fef6157f-21de-4bda-8e92-7cbe9223dda4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:36 devstack sudo[89734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fef6157f-21de-4bda-8e92-7cbe9223dda4
Apr 27 15:16:36 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:36 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a" returned: 1 in 0.521s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG cinder.volume.volume_utils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Downloaded image 17408032-d085-42b0-a4db-fa0192e428de ((None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}])) to volume 6c5c9d23-e47e-4739-8862-6b9712e6b22a successfully. {{(pid=81538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Temporary image 17408032-d085-42b0-a4db-fa0192e428de for user e32c49961c37419dbab449edec51198d is deleted. {{(pid=81538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG cinder.volume.volume_utils [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Marking volume 6c5c9d23-e47e-4739-8862-6b9712e6b22a as bootable. {{(pid=81538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Copying metadata from image 17408032-d085-42b0-a4db-fa0192e428de to 6c5c9d23-e47e-4739-8862-6b9712e6b22a. {{(pid=81538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Creating volume glance metadata for volume 6c5c9d23-e47e-4739-8862-6b9712e6b22a backed by image 17408032-d085-42b0-a4db-fa0192e428de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1191a2ad-5d5c-4a21-8c61-f69d88c9cfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a', 'volume_size': 1, 'image_id': '17408032-d085-42b0-a4db-fa0192e428de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/17408032-d085-42b0-a4db-fa0192e428de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8b5f6f0ff7c46c9826225de4a824e37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '17408032-d085-42b0-a4db-fa0192e428de', 'created_at': datetime.datetime(2026, 4, 27, 13, 1, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 27, 13, 1, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/17408032-d085-42b0-a4db-fa0192e428de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f59e4d15090>}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b752b9-c33a-4381-ac24-c1bb3811d3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:36 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Volume volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a (6c5c9d23-e47e-4739-8862-6b9712e6b22a): created successfully
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b752b9-c33a-4381-ac24-c1bb3811d3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Flow 'volume_create_manager' (f2e4fe56-4734-4cfb-a704-bf963aefe950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:36 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-00e5dcfa-0f74-46b4-835c-f5f9c56a94f1 tempest-VolumesGetTest-1914569613 None] Created volume successfully.
Apr 27 15:16:36 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fef6157f-21de-4bda-8e92-7cbe9223dda4" returned: 0 in 0.536s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fef6157f-21de-4bda-8e92-7cbe9223dda4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:36 devstack sudo[89742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fef6157f-21de-4bda-8e92-7cbe9223dda4
Apr 27 15:16:36 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:36 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fef6157f-21de-4bda-8e92-7cbe9223dda4" returned: 0 in 0.419s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:36 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Lock "cinder-quobyte-fef6157f-21de-4bda-8e92-7cbe9223dda4" released by "delete_volume" :: held 0.992s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Created reservations ['b9fa80b6-aaf7-4509-87a7-8bd217379dc9', '4264ed82-4844-4e3c-87f7-be05a5b9348d', '37252b74-eb58-498c-aaef-4cf64a436a76', '91c9183f-a823-4544-800b-5e0f22c3c49d'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:37 devstack sudo[89745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:16:37 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:37 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.495s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:16:37 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Deleted volume successfully.
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-23a14a7f-cf8d-4845-9415-c14ce68b36ef tempest-VolumesNegativeTest-370674646 None] Lock "cinder-fef6157f-21de-4bda-8e92-7cbe9223dda4-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Flow 'volume_create_manager' (4f399e85-3642-4b87-adc2-b556aa440b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d7d1a4-174d-488f-a456-c750df41dfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d7d1a4-174d-488f-a456-c750df41dfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-55139468',display_name='tempest-VolumesGetTest-Volume-1163818640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58e096c-4b8e-4781-a38d-8d94ee55f584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92152e044e9542b19af465690dddcc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:38Z,use_quota=True,user_id='e32c49961c37419dbab449edec51198d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29f91b6-f18c-4d59-9584-16644e708688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29f91b6-f18c-4d59-9584-16644e708688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa31e2fd-102a-4fe8-9545-9e35628b1c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa31e2fd-102a-4fe8-9545-9e35628b1c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b58e096c-4b8e-4781-a38d-8d94ee55f584', 'volume_name': 'volume-b58e096c-4b8e-4781-a38d-8d94ee55f584', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b26035-b717-4278-ae4a-d6c0ac0c8577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b26035-b717-4278-ae4a-d6c0ac0c8577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ddd6eb-2292-4ae1-af23-fa8895257faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:37 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Volume b58e096c-4b8e-4781-a38d-8d94ee55f584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b58e096c-4b8e-4781-a38d-8d94ee55f584', 'volume_size': 1}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-55139468',display_name='tempest-VolumesGetTest-Volume-1163818640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58e096c-4b8e-4781-a38d-8d94ee55f584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92152e044e9542b19af465690dddcc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:38Z,use_quota=True,user_id='e32c49961c37419dbab449edec51198d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Creating volume b58e096c-4b8e-4781-a38d-8d94ee55f584 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:16:37 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:16:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b58e096c-4b8e-4781-a38d-8d94ee55f584 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:38 devstack sudo[89748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b58e096c-4b8e-4781-a38d-8d94ee55f584 1073741824
Apr 27 15:16:38 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:38 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b58e096c-4b8e-4781-a38d-8d94ee55f584 1073741824" returned: 0 in 0.676s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b58e096c-4b8e-4781-a38d-8d94ee55f584 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:38 devstack sudo[89754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b58e096c-4b8e-4781-a38d-8d94ee55f584
Apr 27 15:16:38 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:39 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b58e096c-4b8e-4781-a38d-8d94ee55f584" returned: 0 in 0.561s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:16:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ddd6eb-2292-4ae1-af23-fa8895257faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b58e096c-4b8e-4781-a38d-8d94ee55f584', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ce15ca-cde3-47db-a875-36a9ccddcb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:39 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Volume volume-b58e096c-4b8e-4781-a38d-8d94ee55f584 (b58e096c-4b8e-4781-a38d-8d94ee55f584): created successfully
Apr 27 15:16:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ce15ca-cde3-47db-a875-36a9ccddcb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Flow 'volume_create_manager' (4f399e85-3642-4b87-adc2-b556aa440b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f6792d90-f454-48df-b1e4-e3c0c6e57ead tempest-VolumesGetTest-1914569613 None] Created volume successfully.
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-b58e096c-4b8e-4781-a38d-8d94ee55f584-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Lock "cinder-b58e096c-4b8e-4781-a38d-8d94ee55f584-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-quobyte-b58e096c-4b8e-4781-a38d-8d94ee55f584" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-b58e096c-4b8e-4781-a38d-8d94ee55f584" acquired by "delete_volume" :: waited 0.025s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[047d376e-23fa-4394-8194-512e0c2acdce]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b58e096c-4b8e-4781-a38d-8d94ee55f584 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:40 devstack sudo[89758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b58e096c-4b8e-4781-a38d-8d94ee55f584
Apr 27 15:16:40 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Flow 'volume_create_manager' (de8fa60d-f93d-404d-8580-fc0f80add425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21468e95-a5ea-4d29-8df7-0e6da522a031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21468e95-a5ea-4d29-8df7-0e6da522a031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2125689691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd2d527-c5c3-486b-9395-81694fba32ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12980a766f6d46c3804d3b546542fbb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:40Z,use_quota=True,user_id='6dcaa1c05b9240d2a31c2803c78becbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3b4d9f-5a14-4111-8cc4-c24662b643f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3b4d9f-5a14-4111-8cc4-c24662b643f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f16e3f5-2cc8-4c0c-9922-ea5cf03b7e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f16e3f5-2cc8-4c0c-9922-ea5cf03b7e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dd2d527-c5c3-486b-9395-81694fba32ce', 'volume_name': 'volume-5dd2d527-c5c3-486b-9395-81694fba32ce', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3426f749-2acb-40d6-b658-166602aa65fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3426f749-2acb-40d6-b658-166602aa65fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d090d8ee-55c1-4cb4-86ba-e182979d291f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:40 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Volume 5dd2d527-c5c3-486b-9395-81694fba32ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dd2d527-c5c3-486b-9395-81694fba32ce', 'volume_size': 1}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2125689691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd2d527-c5c3-486b-9395-81694fba32ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12980a766f6d46c3804d3b546542fbb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:40Z,use_quota=True,user_id='6dcaa1c05b9240d2a31c2803c78becbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Creating volume 5dd2d527-c5c3-486b-9395-81694fba32ce {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:16:40 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:40 devstack sudo[89760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce 1073741824
Apr 27 15:16:40 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:40 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b58e096c-4b8e-4781-a38d-8d94ee55f584" returned: 0 in 0.550s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b58e096c-4b8e-4781-a38d-8d94ee55f584 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:40 devstack sudo[89765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b58e096c-4b8e-4781-a38d-8d94ee55f584
Apr 27 15:16:40 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:41 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce 1073741824" returned: 0 in 0.625s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:41 devstack sudo[89770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce
Apr 27 15:16:41 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:41 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b58e096c-4b8e-4781-a38d-8d94ee55f584" returned: 0 in 0.487s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-b58e096c-4b8e-4781-a38d-8d94ee55f584" released by "delete_volume" :: held 1.080s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Created reservations ['e365648b-e569-4326-8a49-752a1d5c4c2c', '33858926-6ef4-4664-9671-17db33bfdf2b', 'cdcfc579-cc6a-4e08-9970-7c8d2d93d5f9', 'ccc2a941-0b29-4449-9009-8155669f6a29'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:41 devstack sudo[89773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:16:41 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:41 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce" returned: 0 in 0.484s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d090d8ee-55c1-4cb4-86ba-e182979d291f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dd2d527-c5c3-486b-9395-81694fba32ce', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9395affb-7787-499e-a64a-e1bd5f4b6e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:41 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Volume volume-5dd2d527-c5c3-486b-9395-81694fba32ce (5dd2d527-c5c3-486b-9395-81694fba32ce): created successfully
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9395affb-7787-499e-a64a-e1bd5f4b6e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Flow 'volume_create_manager' (de8fa60d-f93d-404d-8580-fc0f80add425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:41 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-19751135-e5e1-4a39-9d7e-136e0a2ad842 tempest-VolumesSnapshotListTestJSON-1779604951 None] Created volume successfully.
Apr 27 15:16:41 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.464s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:16:41 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Deleted volume successfully.
Apr 27 15:16:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-9c4ada91-56ee-47ab-aad9-95264fb58a16 tempest-VolumesGetTest-1914569613 None] Lock "cinder-b58e096c-4b8e-4781-a38d-8d94ee55f584-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-6c5c9d23-e47e-4739-8862-6b9712e6b22a-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Lock "cinder-6c5c9d23-e47e-4739-8862-6b9712e6b22a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Acquiring lock "cinder-quobyte-6c5c9d23-e47e-4739-8862-6b9712e6b22a" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-6c5c9d23-e47e-4739-8862-6b9712e6b22a" acquired by "delete_volume" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:42 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0765ab-67ff-4358-9a35-8747a9b4490b]: (4, 'raw') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:42 devstack sudo[89777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a
Apr 27 15:16:42 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] Creating offline snapshot b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c of volume 5dd2d527-c5c3-486b-9395-81694fba32ce {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:16:42 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ac8a5d-9d58-40a4-8feb-86ad2b289c96]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:42 devstack sudo[89779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce
Apr 27 15:16:42 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:43 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a" returned: 0 in 0.554s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:43 devstack sudo[89783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a
Apr 27 15:16:43 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:43 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce" returned: 0 in 0.531s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:43 devstack sudo[89788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c 1G
Apr 27 15:16:43 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:43 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a" returned: 1 in 0.527s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a' failed. Not Retrying. {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 27 15:16:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:43 devstack sudo[89793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a
Apr 27 15:16:43 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:43 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c 1G" returned: 0 in 0.613s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd2d527-c5c3-486b-9395-81694fba32ce -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:43 devstack sudo[89798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd2d527-c5c3-486b-9395-81694fba32ce -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c
Apr 27 15:16:43 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:44 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6c5c9d23-e47e-4739-8862-6b9712e6b22a" returned: 0 in 0.465s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Lock "cinder-quobyte-6c5c9d23-e47e-4739-8862-6b9712e6b22a" released by "delete_volume" :: held 1.608s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Created reservations ['3b357ba6-ac87-4394-b62e-4b576992fd9c', 'fc0e9193-e26d-4f81-9086-3afb3011f678', '639ead87-600a-4a89-a2d0-e035ab3da3f3', '985eb480-aec8-4a66-801c-8b77e1def94d'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:44 devstack sudo[89801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:16:44 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:44 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd2d527-c5c3-486b-9395-81694fba32ce -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c" returned: 0 in 0.474s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:44 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c is being set with open permissions: ugo+rw
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:44 devstack sudo[89806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c
Apr 27 15:16:44 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:44 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.493s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:16:44 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Deleted volume successfully.
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1a9afaca-ff29-45b3-8ccc-3dea447fa02e tempest-VolumesGetTest-1914569613 None] Lock "cinder-6c5c9d23-e47e-4739-8862-6b9712e6b22a-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:44 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c" returned: 0 in 0.491s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:44 devstack sudo[89810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.info
Apr 27 15:16:44 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:45 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.info" returned: 0 in 0.491s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:45 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.info is being set with open permissions: ugo+rw
Apr 27 15:16:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:45 devstack sudo[89813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.info
Apr 27 15:16:45 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:45 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.info" returned: 0 in 0.471s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.152s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:45 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ba55a70b-d3ac-4737-97ce-e93683ed047f tempest-VolumesSnapshotListTestJSON-1779604951 None] Create snapshot completed successfully
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] Creating offline snapshot 52c78edb-1cb8-4652-a88f-c2deabcfb6ed of volume 5dd2d527-c5c3-486b-9395-81694fba32ce {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Flow 'volume_create_manager' (28b6fe9b-cf3a-4ff0-84d2-9db90898f6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e02035-5e60-4efd-9726-b9feafd9a5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[674643bc-a0f5-46ce-aafd-54d396073d4d]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e02035-5e60-4efd-9726-b9feafd9a5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-339655499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b02aa88-75bb-4253-8474-ef485361b39a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f586603a58fa436785984391494ccc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:47Z,use_quota=True,user_id='6f5500c738fd4340bf732b1255fc05bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db8c5b1-18cc-4d3c-9d52-bb4d6e4b1bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db8c5b1-18cc-4d3c-9d52-bb4d6e4b1bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e42a1d0-0e9b-434a-89ba-025d5457895f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e42a1d0-0e9b-434a-89ba-025d5457895f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b02aa88-75bb-4253-8474-ef485361b39a', 'volume_name': 'volume-6b02aa88-75bb-4253-8474-ef485361b39a', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b14460-8c39-4b5a-a865-931e7050cf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b14460-8c39-4b5a-a865-931e7050cf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63726a05-7499-4cec-b10a-2e5fed87da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:47 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Volume 6b02aa88-75bb-4253-8474-ef485361b39a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b02aa88-75bb-4253-8474-ef485361b39a', 'volume_size': 1}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:47 devstack sudo[89818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c
Apr 27 15:16:47 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:47 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c" returned: 0 in 0.515s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dd2d527-c5c3-486b-9395-81694fba32ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:16:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:47 devstack sudo[89823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed 1G
Apr 27 15:16:47 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:48 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed 1G" returned: 0 in 0.611s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:48 devstack sudo[89829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed
Apr 27 15:16:48 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:48 devstack cinder-volume[81538]: DEBUG oslo_service.periodic_task [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81538) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:16:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:48 devstack sudo[89834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:16:48 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:48 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed" returned: 0 in 0.473s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:48 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed is being set with open permissions: ugo+rw
Apr 27 15:16:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:48 devstack sudo[89836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed
Apr 27 15:16:48 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:49 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.444s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:16:49 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed" returned: 0 in 0.428s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.065s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-339655499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b02aa88-75bb-4253-8474-ef485361b39a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f586603a58fa436785984391494ccc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:47Z,use_quota=True,user_id='6f5500c738fd4340bf732b1255fc05bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Creating volume 6b02aa88-75bb-4253-8474-ef485361b39a {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:16:49 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6b02aa88-75bb-4253-8474-ef485361b39a 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:49 devstack sudo[89840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6b02aa88-75bb-4253-8474-ef485361b39a 1073741824
Apr 27 15:16:49 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:49 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-a3ffb7a1-eacf-4ec2-9747-ff4384f5b022 tempest-VolumesSnapshotListTestJSON-1779604951 None] Create snapshot completed successfully
Apr 27 15:16:49 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6b02aa88-75bb-4253-8474-ef485361b39a 1073741824" returned: 0 in 0.601s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6b02aa88-75bb-4253-8474-ef485361b39a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:50 devstack sudo[89845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6b02aa88-75bb-4253-8474-ef485361b39a
Apr 27 15:16:50 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:50 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6b02aa88-75bb-4253-8474-ef485361b39a" returned: 0 in 0.450s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:16:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.080s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63726a05-7499-4cec-b10a-2e5fed87da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b02aa88-75bb-4253-8474-ef485361b39a', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9228731f-f8ec-4c08-8aaf-1a8b539c3d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:50 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] Creating offline snapshot 831e99a6-2ded-44d7-b8ac-96ad4dacb3ba of volume 5dd2d527-c5c3-486b-9395-81694fba32ce {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:16:50 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Volume volume-6b02aa88-75bb-4253-8474-ef485361b39a (6b02aa88-75bb-4253-8474-ef485361b39a): created successfully
Apr 27 15:16:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9228731f-f8ec-4c08-8aaf-1a8b539c3d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Flow 'volume_create_manager' (28b6fe9b-cf3a-4ff0-84d2-9db90898f6a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:50 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2d1746-c6fa-45ed-ba6a-f32ec60593ec]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:50 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-2852b5c9-0c30-4e9e-b93a-0fc897a2650b tempest-VolumesListTestJSON-1598491001 None] Created volume successfully.
Apr 27 15:16:50 devstack sudo[89848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed
Apr 27 15:16:50 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:51 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed" returned: 0 in 0.498s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dd2d527-c5c3-486b-9395-81694fba32ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:51 devstack sudo[89853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba 1G
Apr 27 15:16:51 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:51 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba 1G" returned: 0 in 0.712s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:51 devstack sudo[89858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba
Apr 27 15:16:51 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Flow 'volume_create_manager' (0f169dfd-f270-46c9-ad9a-fcc0bea806f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28c7ea8-4280-478b-b93f-1b81937b251a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28c7ea8-4280-478b-b93f-1b81937b251a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2085931671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f586603a58fa436785984391494ccc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:52Z,use_quota=True,user_id='6f5500c738fd4340bf732b1255fc05bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1774a51d-1e75-4ef3-8a54-2fc111ef35fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1774a51d-1e75-4ef3-8a54-2fc111ef35fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970f8717-4de0-45ee-9ff7-4503962927a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970f8717-4de0-45ee-9ff7-4503962927a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8', 'volume_name': 'volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1331295-8752-4b2c-8204-1c488d47bf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1331295-8752-4b2c-8204-1c488d47bf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1763f28-3b31-42e2-9bf7-2036e8a1e085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:51 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Volume ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8', 'volume_size': 1}
Apr 27 15:16:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:52 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba" returned: 0 in 0.528s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:52 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba is being set with open permissions: ugo+rw
Apr 27 15:16:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:52 devstack sudo[89864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba
Apr 27 15:16:52 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:52 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba" returned: 0 in 0.473s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.911s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2085931671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f586603a58fa436785984391494ccc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:52Z,use_quota=True,user_id='6f5500c738fd4340bf732b1255fc05bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:16:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Creating volume ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:16:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:16:52 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:16:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:52 devstack sudo[89868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8 1073741824
Apr 27 15:16:52 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:52 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-c8a191f9-31e8-4286-a57f-19022963b526 tempest-VolumesSnapshotListTestJSON-1779604951 None] Create snapshot completed successfully
Apr 27 15:16:53 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8 1073741824" returned: 0 in 0.601s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:53 devstack sudo[89873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8
Apr 27 15:16:53 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:53 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8" returned: 0 in 0.519s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:16:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1763f28-3b31-42e2-9bf7-2036e8a1e085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:53 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306343b9-f5c0-436a-8e28-141b8684f0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:54 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Volume volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8 (ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8): created successfully
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306343b9-f5c0-436a-8e28-141b8684f0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Flow 'volume_create_manager' (0f169dfd-f270-46c9-ad9a-fcc0bea806f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:54 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-144dfc41-c338-4867-8fd7-697315b6c5e0 tempest-VolumesListTestJSON-1598491001 None] Created volume successfully.
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "cinder-831e99a6-2ded-44d7-b8ac-96ad4dacb3ba-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-831e99a6-2ded-44d7-b8ac-96ad4dacb3ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "cinder-quobyte-5dd2d527-c5c3-486b-9395-81694fba32ce" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-quobyte-5dd2d527-c5c3-486b-9395-81694fba32ce" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "cinder-quobyte-831e99a6-2ded-44d7-b8ac-96ad4dacb3ba" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-quobyte-831e99a6-2ded-44d7-b8ac-96ad4dacb3ba" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Deleting offline snapshot 831e99a6-2ded-44d7-b8ac-96ad4dacb3ba of volume 5dd2d527-c5c3-486b-9395-81694fba32ce {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] snapshot_file for this snap is: volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e9ccb8-4daa-4803-aeba-bf87e35e3108]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:54 devstack sudo[89876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba
Apr 27 15:16:54 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:54 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba" returned: 0 in 0.510s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dd2d527-c5c3-486b-9395-81694fba32ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[134cf3e1-242e-471e-8bc4-bd108fba7f53]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:54 devstack sudo[89881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed
Apr 27 15:16:54 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Flow 'volume_create_manager' (b8972b24-cb99-4a2e-b9ad-e01cb47e1e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c38cec2-357f-47f7-9d8c-fa8a7434f068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c38cec2-357f-47f7-9d8c-fa8a7434f068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-556854024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3174c29b-7e93-41de-a66e-09c577106af4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f586603a58fa436785984391494ccc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:55Z,use_quota=True,user_id='6f5500c738fd4340bf732b1255fc05bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d750d1-0da2-4677-84e8-3704346b8f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d750d1-0da2-4677-84e8-3704346b8f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd4d32f-462b-4600-b196-5a55ebe91f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd4d32f-462b-4600-b196-5a55ebe91f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3174c29b-7e93-41de-a66e-09c577106af4', 'volume_name': 'volume-3174c29b-7e93-41de-a66e-09c577106af4', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b5462c-72ff-4d31-b10a-d7f1a6fbeb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b5462c-72ff-4d31-b10a-d7f1a6fbeb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2dd19c-c989-432c-9bbb-f844f8b66125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:55 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Volume 3174c29b-7e93-41de-a66e-09c577106af4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3174c29b-7e93-41de-a66e-09c577106af4', 'volume_size': 1}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-556854024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3174c29b-7e93-41de-a66e-09c577106af4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f586603a58fa436785984391494ccc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:16:55Z,use_quota=True,user_id='6f5500c738fd4340bf732b1255fc05bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Creating volume 3174c29b-7e93-41de-a66e-09c577106af4 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:16:55 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3174c29b-7e93-41de-a66e-09c577106af4 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:55 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed" returned: 0 in 0.579s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dd2d527-c5c3-486b-9395-81694fba32ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:16:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:55 devstack sudo[89886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3174c29b-7e93-41de-a66e-09c577106af4 1073741824
Apr 27 15:16:55 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:55 devstack sudo[89887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba
Apr 27 15:16:55 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:56 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3174c29b-7e93-41de-a66e-09c577106af4 1073741824" returned: 0 in 0.598s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3174c29b-7e93-41de-a66e-09c577106af4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:56 devstack sudo[89896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3174c29b-7e93-41de-a66e-09c577106af4
Apr 27 15:16:56 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:56 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba" returned: 0 in 0.675s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:56 devstack sudo[89898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba
Apr 27 15:16:56 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:56 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3174c29b-7e93-41de-a66e-09c577106af4" returned: 0 in 0.446s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2dd19c-c989-432c-9bbb-f844f8b66125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3174c29b-7e93-41de-a66e-09c577106af4', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea314d3-c836-4795-8d79-091770929f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:16:56 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Volume volume-3174c29b-7e93-41de-a66e-09c577106af4 (3174c29b-7e93-41de-a66e-09c577106af4): created successfully
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea314d3-c836-4795-8d79-091770929f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Flow 'volume_create_manager' (b8972b24-cb99-4a2e-b9ad-e01cb47e1e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:16:56 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-eb10a2bf-b5b3-42af-a0de-40deaa7a34e7 tempest-VolumesListTestJSON-1598491001 None] Created volume successfully.
Apr 27 15:16:56 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.831e99a6-2ded-44d7-b8ac-96ad4dacb3ba" returned: 0 in 0.449s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-quobyte-831e99a6-2ded-44d7-b8ac-96ad4dacb3ba" released by "_delete_snapshot" :: held 2.313s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-quobyte-5dd2d527-c5c3-486b-9395-81694fba32ce" released by "delete_snapshot" :: held 2.335s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Created reservations ['7aa5834b-fa24-4be0-97c6-b45f61ca3b58', 'b60fa839-e504-433a-995b-66d657c3bc16', 'b7d8754c-e6c7-4f64-9be1-bf9ba55e3616', '732075ae-76f2-4847-9e57-89187dab6b14'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:16:56 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Delete snapshot completed successfully.
Apr 27 15:16:56 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-29ff21bc-6eb5-48c1-bea6-f046c7a8aff2 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-831e99a6-2ded-44d7-b8ac-96ad4dacb3ba-delete_snapshot" released by "delete_snapshot" :: held 2.462s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:57 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "cinder-52c78edb-1cb8-4652-a88f-c2deabcfb6ed-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:57 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-52c78edb-1cb8-4652-a88f-c2deabcfb6ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:57 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "cinder-quobyte-5dd2d527-c5c3-486b-9395-81694fba32ce" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:57 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-quobyte-5dd2d527-c5c3-486b-9395-81694fba32ce" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:57 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "cinder-quobyte-52c78edb-1cb8-4652-a88f-c2deabcfb6ed" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:57 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-quobyte-52c78edb-1cb8-4652-a88f-c2deabcfb6ed" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:57 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Deleting offline snapshot 52c78edb-1cb8-4652-a88f-c2deabcfb6ed of volume 5dd2d527-c5c3-486b-9395-81694fba32ce {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:16:57 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] snapshot_file for this snap is: volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:16:57 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4a7d26-3130-44bb-bd14-8d43c706cc11]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:57 devstack sudo[89904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed
Apr 27 15:16:57 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:58 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed" returned: 0 in 0.508s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:58 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dd2d527-c5c3-486b-9395-81694fba32ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:16:58 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c76f3c-2800-42f5-bf5f-4a5b0d7d3c1b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:58 devstack sudo[89909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c
Apr 27 15:16:58 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:58 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c" returned: 0 in 0.525s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:58 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dd2d527-c5c3-486b-9395-81694fba32ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:16:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:58 devstack sudo[89915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed
Apr 27 15:16:58 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:59 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed" returned: 0 in 0.626s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:59 devstack sudo[89920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed
Apr 27 15:16:59 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "cinder-3174c29b-7e93-41de-a66e-09c577106af4-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Lock "cinder-3174c29b-7e93-41de-a66e-09c577106af4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "cinder-quobyte-3174c29b-7e93-41de-a66e-09c577106af4" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:16:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Lock "cinder-quobyte-3174c29b-7e93-41de-a66e-09c577106af4" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:16:59 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d68aa6d-57ea-45d2-a08f-921b2547fea5]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:16:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3174c29b-7e93-41de-a66e-09c577106af4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:16:59 devstack sudo[89922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3174c29b-7e93-41de-a66e-09c577106af4
Apr 27 15:16:59 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:16:59 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root
Apr 27 15:16:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.52c78edb-1cb8-4652-a88f-c2deabcfb6ed" returned: 0 in 0.465s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:16:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-quobyte-52c78edb-1cb8-4652-a88f-c2deabcfb6ed" released by "_delete_snapshot" :: held 2.213s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:59 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-quobyte-5dd2d527-c5c3-486b-9395-81694fba32ce" released by "delete_snapshot" :: held 2.239s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:16:59 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Created reservations ['906e5680-2521-4555-b8a3-0398f520b8cc', 'a3a82c73-80b6-45af-8cd4-06ccc546a3f3', '2f97bda7-7c90-49f1-a0be-886ea154fe85', '7f937bb7-704e-4bc6-8033-73f62df0eeb7'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:00 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Delete snapshot completed successfully.
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f1fd39f5-7baf-4d9d-8a76-2fc7c9c9bc29 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-52c78edb-1cb8-4652-a88f-c2deabcfb6ed-delete_snapshot" released by "delete_snapshot" :: held 2.377s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:00 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3174c29b-7e93-41de-a66e-09c577106af4" returned: 0 in 0.537s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3174c29b-7e93-41de-a66e-09c577106af4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:00 devstack sudo[89960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3174c29b-7e93-41de-a66e-09c577106af4
Apr 27 15:17:00 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:00 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-3174c29b-7e93-41de-a66e-09c577106af4" returned: 0 in 0.436s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Lock "cinder-quobyte-3174c29b-7e93-41de-a66e-09c577106af4" released by "delete_volume" :: held 1.013s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Created reservations ['49387f4f-239b-49ed-95d8-783fca33ce52', '34b9332a-fd0d-4ced-b42e-547f4b0937c7', '59599d30-1cc8-43be-908c-6acdc85d9d0e', 'a341cadd-6c69-4490-8533-1f2b8f5c30e1'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:00 devstack sudo[89965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:00 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "cinder-b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "cinder-quobyte-5dd2d527-c5c3-486b-9395-81694fba32ce" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-quobyte-5dd2d527-c5c3-486b-9395-81694fba32ce" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "cinder-quobyte-b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-quobyte-b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Deleting offline snapshot b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c of volume 5dd2d527-c5c3-486b-9395-81694fba32ce {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] snapshot_file for this snap is: volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a59584-d409-4c69-9d82-ef74f327fc75]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:01 devstack sudo[89967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c
Apr 27 15:17:01 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:01 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.486s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:01 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:01 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Deleted volume successfully.
Apr 27 15:17:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2c18b01b-8bb4-45e7-9a60-67578ffa6304 tempest-VolumesListTestJSON-1598491001 None] Lock "cinder-3174c29b-7e93-41de-a66e-09c577106af4-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:01 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c" returned: 0 in 0.527s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dd2d527-c5c3-486b-9395-81694fba32ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:17:01 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d381da64-9a28-4bfc-89d8-c7c5f1ade494]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:01 devstack sudo[89973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce
Apr 27 15:17:01 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "cinder-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Lock "cinder-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "cinder-quobyte-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Lock "cinder-quobyte-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8" acquired by "delete_volume" :: waited 0.014s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:01 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65ddb35-bb7c-4026-ac67-36237bdfa83f]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:02 devstack sudo[89982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8
Apr 27 15:17:02 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:02 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce" returned: 0 in 0.558s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:02 devstack sudo[89984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c
Apr 27 15:17:02 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:02 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8" returned: 0 in 0.526s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:02 devstack sudo[89992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8
Apr 27 15:17:02 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:02 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c" returned: 0 in 0.541s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:02 devstack sudo[89994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c
Apr 27 15:17:02 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:02 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8" returned: 0 in 0.431s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Lock "cinder-quobyte-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8" released by "delete_volume" :: held 1.010s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:02 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Created reservations ['7c5e133d-9096-4e83-9528-aed2a54e1624', '3ba3e435-501e-4685-8bc7-2b122e4b63a6', '3d8bcd3f-9324-499f-a5cc-d2a541870ab2', 'bb16ebaf-25e1-4dc3-b551-610a1532bd6e'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:03 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:03 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce.b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c" returned: 0 in 0.480s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:03 devstack sudo[89998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:03 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-quobyte-b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c" released by "_delete_snapshot" :: held 2.206s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-quobyte-5dd2d527-c5c3-486b-9395-81694fba32ce" released by "delete_snapshot" :: held 2.228s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:03 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Created reservations ['5c9aa511-fd37-443c-80f5-03ba3fb2fd18', 'bbf097bc-9e67-4d89-864e-c52842e60a39', '7fd05c18-32e2-4e7c-b006-1f525f5eee5f', '9ffd2c19-fd04-497e-8855-12cf5dcb131e'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:03 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Delete snapshot completed successfully.
Apr 27 15:17:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-42880ddb-32a1-4dd1-8d90-34116b8079b4 tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-b9baae73-a9fc-4e68-9fc0-4ca2ae1f7c5c-delete_snapshot" released by "delete_snapshot" :: held 2.348s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:03 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.459s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:03 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:03 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Deleted volume successfully.
Apr 27 15:17:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-48363a5f-e49f-47a9-a1e5-c78260cd0d1e tempest-VolumesListTestJSON-1598491001 None] Lock "cinder-ab9c3265-25bc-4aca-9e0a-e48cb57bdbc8-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "cinder-5dd2d527-c5c3-486b-9395-81694fba32ce-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-5dd2d527-c5c3-486b-9395-81694fba32ce-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "cinder-6b02aa88-75bb-4253-8474-ef485361b39a-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "cinder-quobyte-5dd2d527-c5c3-486b-9395-81694fba32ce" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Lock "cinder-6b02aa88-75bb-4253-8474-ef485361b39a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-quobyte-5dd2d527-c5c3-486b-9395-81694fba32ce" acquired by "delete_volume" :: waited 0.028s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e2f1c5-f336-4be8-aaa5-8cabd0b8fbc3]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "cinder-quobyte-6b02aa88-75bb-4253-8474-ef485361b39a" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Lock "cinder-quobyte-6b02aa88-75bb-4253-8474-ef485361b39a" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8305f8-2913-4d9d-a46a-f6925a0cdd2f]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6b02aa88-75bb-4253-8474-ef485361b39a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:04 devstack sudo[90001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce
Apr 27 15:17:04 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:04 devstack sudo[90002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6b02aa88-75bb-4253-8474-ef485361b39a
Apr 27 15:17:04 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:04 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce" returned: 0 in 0.501s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:04 devstack sudo[90011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce
Apr 27 15:17:04 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:04 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6b02aa88-75bb-4253-8474-ef485361b39a" returned: 0 in 0.532s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:04 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6b02aa88-75bb-4253-8474-ef485361b39a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:04 devstack sudo[90013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6b02aa88-75bb-4253-8474-ef485361b39a
Apr 27 15:17:04 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:05 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5dd2d527-c5c3-486b-9395-81694fba32ce" returned: 0 in 0.467s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-quobyte-5dd2d527-c5c3-486b-9395-81694fba32ce" released by "delete_volume" :: held 1.037s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:05 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Created reservations ['5457b54e-1391-4af1-b601-27cfed0f5f71', '075c28c8-5428-498c-b61a-da6615b0e5f1', '429061cb-0c19-490e-b49d-a53ded484a53', 'bbb774a9-ad5f-4753-8abb-cd229d8c22b4'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-6b02aa88-75bb-4253-8474-ef485361b39a" returned: 0 in 0.465s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Lock "cinder-quobyte-6b02aa88-75bb-4253-8474-ef485361b39a" released by "delete_volume" :: held 1.039s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Created reservations ['1433d937-0a29-45bb-a1f2-dacf38046261', '73e855c4-1ddf-43f1-a595-07dac5d35f12', 'a9d9cb04-3042-42f1-840e-24bd84ef224f', 'd4ecbd58-4b20-430b-94df-dabde9fa50b7'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:05 devstack sudo[90017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:05 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:05 devstack sudo[90019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:05 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:05 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.422s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:05 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Deleted volume successfully.
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-f7306457-ffd3-43f1-ae9c-38baa61851ce tempest-VolumesSnapshotListTestJSON-1779604951 None] Lock "cinder-5dd2d527-c5c3-486b-9395-81694fba32ce-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:05 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.442s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:05 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Deleted volume successfully.
Apr 27 15:17:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2c143f65-15d9-417d-b5b0-d3c8438b9889 tempest-VolumesListTestJSON-1598491001 None] Lock "cinder-6b02aa88-75bb-4253-8474-ef485361b39a-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:14 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Flow 'volume_create_manager' (e5930d81-1fb3-4d18-8df8-defe4addb75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7656ee2a-d290-4211-8dad-8dcaf0efc4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:14 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7656ee2a-d290-4211-8dad-8dcaf0efc4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270532136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b741e9-615d-4204-a922-f0e544410fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752381a2a2ea4fe69496676943175534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:15Z,use_quota=True,user_id='9224cff5ff624ee8a051cc60fa6bc0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8384400f-d41a-455f-a69a-abd2e51343a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8384400f-d41a-455f-a69a-abd2e51343a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabacaeb-0a1d-4f42-bbe3-7ea63d0a1907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabacaeb-0a1d-4f42-bbe3-7ea63d0a1907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96b741e9-615d-4204-a922-f0e544410fcf', 'volume_name': 'volume-96b741e9-615d-4204-a922-f0e544410fcf', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c3e83e-0f55-4418-af93-dd9b786a204e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c3e83e-0f55-4418-af93-dd9b786a204e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d19ba1-cb15-4308-8a47-126348012482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Volume 96b741e9-615d-4204-a922-f0e544410fcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96b741e9-615d-4204-a922-f0e544410fcf', 'volume_size': 1}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270532136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b741e9-615d-4204-a922-f0e544410fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752381a2a2ea4fe69496676943175534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:15Z,use_quota=True,user_id='9224cff5ff624ee8a051cc60fa6bc0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Creating volume 96b741e9-615d-4204-a922-f0e544410fcf {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:15 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96b741e9-615d-4204-a922-f0e544410fcf 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:15 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96b741e9-615d-4204-a922-f0e544410fcf 1073741824
Apr 27 15:17:15 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Flow 'volume_create_manager' (bdaed94a-646a-45db-98ef-6b75c24b9179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5242c1c4-14bb-40af-bc0c-ed790a0f3328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5242c1c4-14bb-40af-bc0c-ed790a0f3328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2146050395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8e1432-73bc-43bc-bb06-6666fce716d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b725c1c57de4937a78ca6a4d32bbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:15Z,use_quota=True,user_id='24d9f1e7f1b94a36b6e43eda50e6eb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76708948-c57d-4b17-9d86-53d3012d100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76708948-c57d-4b17-9d86-53d3012d100c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0419757-143f-4ed7-a264-ad91576933a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0419757-143f-4ed7-a264-ad91576933a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd8e1432-73bc-43bc-bb06-6666fce716d1', 'volume_name': 'volume-dd8e1432-73bc-43bc-bb06-6666fce716d1', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13efe12-f587-4d02-9d79-93667fed54e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13efe12-f587-4d02-9d79-93667fed54e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa9e2f0-2c85-4a52-baca-9cc3fb2ba38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume dd8e1432-73bc-43bc-bb06-6666fce716d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd8e1432-73bc-43bc-bb06-6666fce716d1', 'volume_size': 1}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Flow 'volume_create_manager' (22697c82-a9c4-407d-adb2-88d64b0aaaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d32853-f70c-474e-92f8-78f375c99441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Flow 'volume_create_manager' (73b28c23-17ea-4ff8-8d0c-8288007c6d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de76d6a0-9af8-463c-9751-0d72cc29df3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d32853-f70c-474e-92f8-78f375c99441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-973028225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a59ff4-7b1d-4c7c-b726-9dc521d3308e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb44773f6b34fa187bd8845c1fd33f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:15Z,use_quota=True,user_id='9fa51d375b0a4804bc689bd9fc560dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66bfe486-7016-4089-83c0-650cbd0a1899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66bfe486-7016-4089-83c0-650cbd0a1899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79fcc3e-35a8-4b41-bdef-12b91a210fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79fcc3e-35a8-4b41-bdef-12b91a210fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5a59ff4-7b1d-4c7c-b726-9dc521d3308e', 'volume_name': 'volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c87821-0150-40e8-a63f-b0ca12b39c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c87821-0150-40e8-a63f-b0ca12b39c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5da4ab3-d8c5-4d9e-acc1-674ac1f83a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Volume e5a59ff4-7b1d-4c7c-b726-9dc521d3308e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e', 'volume_size': 1}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de76d6a0-9af8-463c-9751-0d72cc29df3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-590023592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fac5214-224e-469e-9e09-05810873587b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752381a2a2ea4fe69496676943175534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:15Z,use_quota=True,user_id='9224cff5ff624ee8a051cc60fa6bc0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276e6ba3-36fc-4639-b369-2fd172a1d007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276e6ba3-36fc-4639-b369-2fd172a1d007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb18a13-55be-409b-8350-ad5128c75580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb18a13-55be-409b-8350-ad5128c75580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fac5214-224e-469e-9e09-05810873587b', 'volume_name': 'volume-5fac5214-224e-469e-9e09-05810873587b', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401b8b63-2efc-42af-95b9-838cc9d73a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401b8b63-2efc-42af-95b9-838cc9d73a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6652788-f712-4450-9b24-edeced543630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Volume 5fac5214-224e-469e-9e09-05810873587b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fac5214-224e-469e-9e09-05810873587b', 'volume_size': 1}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Flow 'volume_create_manager' (47ea3969-3e7a-4e2c-a61b-a6f6f5964e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f5b0b6-c270-4fcc-82be-9249bfcd2671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f5b0b6-c270-4fcc-82be-9249bfcd2671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1130246824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d4b6ef-754f-47f8-8b61-07ae1f0a380a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752381a2a2ea4fe69496676943175534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:16Z,use_quota=True,user_id='9224cff5ff624ee8a051cc60fa6bc0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad7c55f-50e4-4e1d-a1b8-c36a02bea175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad7c55f-50e4-4e1d-a1b8-c36a02bea175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fb6299-b638-4b35-9491-ca7655d02326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fb6299-b638-4b35-9491-ca7655d02326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d4b6ef-754f-47f8-8b61-07ae1f0a380a', 'volume_name': 'volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4a284d-6efb-4486-96de-622927346f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4a284d-6efb-4486-96de-622927346f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894195b5-d4f1-4438-9b2c-030fc8d6aef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:15 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Volume 68d4b6ef-754f-47f8-8b61-07ae1f0a380a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a', 'volume_size': 1}
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:15 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96b741e9-615d-4204-a922-f0e544410fcf 1073741824" returned: 0 in 0.937s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:UPDATE=133,cinder:SELECT=99,cinder:INSERT=35,cinder:DELETE=13 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96b741e9-615d-4204-a922-f0e544410fcf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:16 devstack sudo[90068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96b741e9-615d-4204-a922-f0e544410fcf
Apr 27 15:17:16 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Flow 'volume_create_manager' (c72f407e-6e57-41fe-b5bb-99b6a63303d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0aef88d-e8b1-403a-b5b3-fbb23a1b1e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0aef88d-e8b1-403a-b5b3-fbb23a1b1e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1476935463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9689997e-4138-486b-8062-0af3760510e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752381a2a2ea4fe69496676943175534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:16Z,use_quota=True,user_id='9224cff5ff624ee8a051cc60fa6bc0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f6ca42-6a59-40a4-a1ce-a65c75162b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f6ca42-6a59-40a4-a1ce-a65c75162b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab149d8-6bc4-4b94-8abe-76098e2a232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab149d8-6bc4-4b94-8abe-76098e2a232d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9689997e-4138-486b-8062-0af3760510e0', 'volume_name': 'volume-9689997e-4138-486b-8062-0af3760510e0', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b69c441-6472-4283-bbbb-3940304640a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b69c441-6472-4283-bbbb-3940304640a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7b1bbd-6bb4-4872-a722-2cb0bcce025d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:16 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Volume 9689997e-4138-486b-8062-0af3760510e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9689997e-4138-486b-8062-0af3760510e0', 'volume_size': 1}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Flow 'volume_create_manager' (4cf29629-5148-4d69-b4b5-fc37fa11abe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3e5d04-af1d-4406-bfd0-d9e11d7d6951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3e5d04-af1d-4406-bfd0-d9e11d7d6951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2038870503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd94ac66-e02e-455e-8a72-4e8a755c2143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752381a2a2ea4fe69496676943175534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:16Z,use_quota=True,user_id='9224cff5ff624ee8a051cc60fa6bc0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e8ce49-b7c2-4f1c-be70-ed23bb9ad035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e8ce49-b7c2-4f1c-be70-ed23bb9ad035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04417fb-db69-4486-9a48-45b2adccca7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04417fb-db69-4486-9a48-45b2adccca7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd94ac66-e02e-455e-8a72-4e8a755c2143', 'volume_name': 'volume-fd94ac66-e02e-455e-8a72-4e8a755c2143', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6742066-d82a-4f60-b6cf-203af4765a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6742066-d82a-4f60-b6cf-203af4765a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e85da52-7597-4155-9901-180a6487c232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:16 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Volume fd94ac66-e02e-455e-8a72-4e8a755c2143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd94ac66-e02e-455e-8a72-4e8a755c2143', 'volume_size': 1}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:16 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96b741e9-615d-4204-a922-f0e544410fcf" returned: 0 in 0.619s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.314s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2146050395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8e1432-73bc-43bc-bb06-6666fce716d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b725c1c57de4937a78ca6a4d32bbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:15Z,use_quota=True,user_id='24d9f1e7f1b94a36b6e43eda50e6eb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Creating volume dd8e1432-73bc-43bc-bb06-6666fce716d1 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:16 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:16 devstack sudo[90071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1 1073741824
Apr 27 15:17:16 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d19ba1-cb15-4308-8a47-126348012482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b741e9-615d-4204-a922-f0e544410fcf', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f26bd6-3f9a-43d5-b420-0ac2117fa2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:16 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Volume volume-96b741e9-615d-4204-a922-f0e544410fcf (96b741e9-615d-4204-a922-f0e544410fcf): created successfully
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f26bd6-3f9a-43d5-b420-0ac2117fa2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:16 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Flow 'volume_create_manager' (e5930d81-1fb3-4d18-8df8-defe4addb75c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:16 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-0c61991a-1cd2-4996-acbf-311b85da9265 tempest-CreateVolumesFromImageTest-1319075823 None] Created volume successfully.
Apr 27 15:17:17 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1 1073741824" returned: 0 in 0.700s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:17 devstack sudo[90076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1
Apr 27 15:17:17 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:17 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1" returned: 0 in 0.470s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.303s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-973028225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a59ff4-7b1d-4c7c-b726-9dc521d3308e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb44773f6b34fa187bd8845c1fd33f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:15Z,use_quota=True,user_id='9fa51d375b0a4804bc689bd9fc560dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Creating volume e5a59ff4-7b1d-4c7c-b726-9dc521d3308e {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:17 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa9e2f0-2c85-4a52-baca-9cc3fb2ba38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd8e1432-73bc-43bc-bb06-6666fce716d1', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:17 devstack sudo[90079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e 1073741824
Apr 27 15:17:17 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d40267e-3728-4142-8076-bde546e2502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:17 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume volume-dd8e1432-73bc-43bc-bb06-6666fce716d1 (dd8e1432-73bc-43bc-bb06-6666fce716d1): created successfully
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d40267e-3728-4142-8076-bde546e2502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:17 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Flow 'volume_create_manager' (bdaed94a-646a-45db-98ef-6b75c24b9179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:17 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-696e013a-d229-432f-b2ca-6693f18437f5 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Created volume successfully.
Apr 27 15:17:18 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=106,cinder:UPDATE=130,cinder:INSERT=40,cinder:DELETE=9 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:17:18 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e 1073741824" returned: 0 in 0.771s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:18 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:18 devstack sudo[90085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e
Apr 27 15:17:18 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:19 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e" returned: 0 in 0.458s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.565s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-590023592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fac5214-224e-469e-9e09-05810873587b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752381a2a2ea4fe69496676943175534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:15Z,use_quota=True,user_id='9224cff5ff624ee8a051cc60fa6bc0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Creating volume 5fac5214-224e-469e-9e09-05810873587b {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:19 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5fac5214-224e-469e-9e09-05810873587b 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5da4ab3-d8c5-4d9e-acc1-674ac1f83a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672a50f0-7f51-4745-aaa7-5ea4c27cb77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:19 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5fac5214-224e-469e-9e09-05810873587b 1073741824
Apr 27 15:17:19 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:19 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Volume volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e (e5a59ff4-7b1d-4c7c-b726-9dc521d3308e): created successfully
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672a50f0-7f51-4745-aaa7-5ea4c27cb77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Flow 'volume_create_manager' (22697c82-a9c4-407d-adb2-88d64b0aaaff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:19 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-bcb585ed-02f8-49ac-91a3-cc94c4a799f9 tempest-VolumeDependencyTests-1616645965 None] Created volume successfully.
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:19 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5fac5214-224e-469e-9e09-05810873587b 1073741824" returned: 0 in 0.771s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5fac5214-224e-469e-9e09-05810873587b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:20 devstack sudo[90093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5fac5214-224e-469e-9e09-05810873587b
Apr 27 15:17:20 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:20 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5fac5214-224e-469e-9e09-05810873587b" returned: 0 in 0.455s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.594s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1130246824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d4b6ef-754f-47f8-8b61-07ae1f0a380a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752381a2a2ea4fe69496676943175534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:16Z,use_quota=True,user_id='9224cff5ff624ee8a051cc60fa6bc0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Creating volume 68d4b6ef-754f-47f8-8b61-07ae1f0a380a {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:20 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6652788-f712-4450-9b24-edeced543630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fac5214-224e-469e-9e09-05810873587b', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5905c73-b479-4de4-921d-ecf0481e7278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:20 devstack sudo[90096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a 1073741824
Apr 27 15:17:20 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:20 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Volume volume-5fac5214-224e-469e-9e09-05810873587b (5fac5214-224e-469e-9e09-05810873587b): created successfully
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5905c73-b479-4de4-921d-ecf0481e7278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:20 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Flow 'volume_create_manager' (73b28c23-17ea-4ff8-8d0c-8288007c6d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:20 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-2d138a39-7e78-4300-97a9-ce3e48332d67 tempest-CreateVolumesFromImageTest-1319075823 None] Created volume successfully.
Apr 27 15:17:21 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a 1073741824" returned: 0 in 0.647s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:21 devstack sudo[90101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a
Apr 27 15:17:21 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:21 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a" returned: 0 in 0.473s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.338s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1476935463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9689997e-4138-486b-8062-0af3760510e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752381a2a2ea4fe69496676943175534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:16Z,use_quota=True,user_id='9224cff5ff624ee8a051cc60fa6bc0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Creating volume 9689997e-4138-486b-8062-0af3760510e0 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:21 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9689997e-4138-486b-8062-0af3760510e0 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:21 devstack sudo[90104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9689997e-4138-486b-8062-0af3760510e0 1073741824
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894195b5-d4f1-4438-9b2c-030fc8d6aef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:21 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d915d166-7b2b-47b4-94ce-62d854192935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:21 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Volume volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a (68d4b6ef-754f-47f8-8b61-07ae1f0a380a): created successfully
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d915d166-7b2b-47b4-94ce-62d854192935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:21 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Flow 'volume_create_manager' (47ea3969-3e7a-4e2c-a61b-a6f6f5964e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:21 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-ebd17068-bd22-4c16-a750-f1329569fcc3 tempest-CreateVolumesFromImageTest-1319075823 None] Created volume successfully.
Apr 27 15:17:22 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9689997e-4138-486b-8062-0af3760510e0 1073741824" returned: 0 in 0.660s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9689997e-4138-486b-8062-0af3760510e0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:22 devstack sudo[90109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9689997e-4138-486b-8062-0af3760510e0
Apr 27 15:17:22 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:22 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9689997e-4138-486b-8062-0af3760510e0" returned: 0 in 0.452s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.270s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2038870503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd94ac66-e02e-455e-8a72-4e8a755c2143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752381a2a2ea4fe69496676943175534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:16Z,use_quota=True,user_id='9224cff5ff624ee8a051cc60fa6bc0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Creating volume fd94ac66-e02e-455e-8a72-4e8a755c2143 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:22 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fd94ac66-e02e-455e-8a72-4e8a755c2143 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:22 devstack sudo[90112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fd94ac66-e02e-455e-8a72-4e8a755c2143 1073741824
Apr 27 15:17:22 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7b1bbd-6bb4-4872-a722-2cb0bcce025d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9689997e-4138-486b-8062-0af3760510e0', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28afaba9-3e9f-4848-a4a2-150a5673e450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:22 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Volume volume-9689997e-4138-486b-8062-0af3760510e0 (9689997e-4138-486b-8062-0af3760510e0): created successfully
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28afaba9-3e9f-4848-a4a2-150a5673e450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:22 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Flow 'volume_create_manager' (c72f407e-6e57-41fe-b5bb-99b6a63303d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:22 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5d1d337f-9e28-4dd0-90ca-212b5dc2e16e tempest-CreateVolumesFromImageTest-1319075823 None] Created volume successfully.
Apr 27 15:17:23 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fd94ac66-e02e-455e-8a72-4e8a755c2143 1073741824" returned: 0 in 0.645s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fd94ac66-e02e-455e-8a72-4e8a755c2143 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:23 devstack sudo[90117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fd94ac66-e02e-455e-8a72-4e8a755c2143
Apr 27 15:17:23 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:24 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fd94ac66-e02e-455e-8a72-4e8a755c2143" returned: 0 in 0.643s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.510s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Creating offline snapshot 7b9b6b18-8f6b-47da-8a51-42f834aad8a6 of volume dd8e1432-73bc-43bc-bb06-6666fce716d1 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:17:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e85da52-7597-4155-9901-180a6487c232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd94ac66-e02e-455e-8a72-4e8a755c2143', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d13820f-b951-4ecc-9041-a38f9c20ea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:24 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d3bb89-3c04-46d2-a7e5-bcd4b836454a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:24 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Volume volume-fd94ac66-e02e-455e-8a72-4e8a755c2143 (fd94ac66-e02e-455e-8a72-4e8a755c2143): created successfully
Apr 27 15:17:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d13820f-b951-4ecc-9041-a38f9c20ea3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Flow 'volume_create_manager' (4cf29629-5148-4d69-b4b5-fc37fa11abe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:24 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-34704c7e-eea6-4ca5-8aad-7d98839ca9db tempest-CreateVolumesFromImageTest-1319075823 None] Created volume successfully.
Apr 27 15:17:24 devstack sudo[90120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1
Apr 27 15:17:24 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:24 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1" returned: 0 in 0.615s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:24 devstack sudo[90125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6 1G
Apr 27 15:17:24 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "cinder-fd94ac66-e02e-455e-8a72-4e8a755c2143-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-fd94ac66-e02e-455e-8a72-4e8a755c2143-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "cinder-quobyte-fd94ac66-e02e-455e-8a72-4e8a755c2143" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-quobyte-fd94ac66-e02e-455e-8a72-4e8a755c2143" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:25 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3c8682-9994-4594-a8ce-556ee6046e53]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fd94ac66-e02e-455e-8a72-4e8a755c2143 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:25 devstack sudo[90130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fd94ac66-e02e-455e-8a72-4e8a755c2143
Apr 27 15:17:25 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:25 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6 1G" returned: 0 in 0.715s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e1432-73bc-43bc-bb06-6666fce716d1 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:25 devstack sudo[90132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e1432-73bc-43bc-bb06-6666fce716d1 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6
Apr 27 15:17:25 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:25 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fd94ac66-e02e-455e-8a72-4e8a755c2143" returned: 0 in 0.640s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fd94ac66-e02e-455e-8a72-4e8a755c2143 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:26 devstack sudo[90139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fd94ac66-e02e-455e-8a72-4e8a755c2143
Apr 27 15:17:26 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:26 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8e1432-73bc-43bc-bb06-6666fce716d1 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6" returned: 0 in 0.590s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:26 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6 is being set with open permissions: ugo+rw
Apr 27 15:17:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:26 devstack sudo[90142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6
Apr 27 15:17:26 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:26 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-fd94ac66-e02e-455e-8a72-4e8a755c2143" returned: 0 in 0.473s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:26 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-quobyte-fd94ac66-e02e-455e-8a72-4e8a755c2143" released by "delete_volume" :: held 1.158s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:26 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Created reservations ['5d7ba7c8-ac65-45fa-bda8-492d9ea8c440', 'c3497bdc-f176-40f1-8025-f8585a262489', '97513554-e0b8-470c-860e-f944ac4715c2', '08a5995a-f898-4351-b763-5acdd69acca2'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:26 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:26 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:26 devstack sudo[90146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:26 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:26 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6" returned: 0 in 0.596s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:26 devstack sudo[90148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.info
Apr 27 15:17:26 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:27 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.507s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:27 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Deleted volume successfully.
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0d0cd31a-948d-41c1-8d04-fdddb85e19c5 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-fd94ac66-e02e-455e-8a72-4e8a755c2143-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:27 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.info" returned: 0 in 0.492s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:27 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.info is being set with open permissions: ugo+rw
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:27 devstack sudo[90152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.info
Apr 27 15:17:27 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "cinder-9689997e-4138-486b-8062-0af3760510e0-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-9689997e-4138-486b-8062-0af3760510e0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "cinder-quobyte-9689997e-4138-486b-8062-0af3760510e0" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-quobyte-9689997e-4138-486b-8062-0af3760510e0" acquired by "delete_volume" :: waited 0.021s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e73fcf-9379-4fc5-9e54-d8adb8c17321]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9689997e-4138-486b-8062-0af3760510e0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:27 devstack sudo[90154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9689997e-4138-486b-8062-0af3760510e0
Apr 27 15:17:27 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:27 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.info" returned: 0 in 0.530s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.638s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.032s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:27 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e45c9573-e045-4880-9a03-8f488e79e442 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Create snapshot completed successfully
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] Creating offline snapshot a74bb992-d636-41d7-9477-cf608f467ccb of volume e5a59ff4-7b1d-4c7c-b726-9dc521d3308e {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe91b901-2064-48bc-8ff6-e0c50de55286]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:27 devstack sudo[90157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e
Apr 27 15:17:27 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:28 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9689997e-4138-486b-8062-0af3760510e0" returned: 0 in 0.568s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9689997e-4138-486b-8062-0af3760510e0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:28 devstack sudo[90162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9689997e-4138-486b-8062-0af3760510e0
Apr 27 15:17:28 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Flow 'volume_create_manager' (3b23c95e-e472-4d84-8c67-5016df2ed81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3ee5cf-7b79-417f-8384-67a82dfc1418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3ee5cf-7b79-417f-8384-67a82dfc1418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-974659840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8552bd-fe36-4c9f-9f4f-bc0213805126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b725c1c57de4937a78ca6a4d32bbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:28Z,use_quota=True,user_id='24d9f1e7f1b94a36b6e43eda50e6eb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55920c9d-de9f-414e-a555-7014a3437f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55920c9d-de9f-414e-a555-7014a3437f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9d6e8b-dc33-41cd-9988-f501f117a773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:28 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9d6e8b-dc33-41cd-9988-f501f117a773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8552bd-fe36-4c9f-9f4f-bc0213805126', 'volume_name': 'volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce1c058-71e4-4595-8e10-b0a9b66b8892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce1c058-71e4-4595-8e10-b0a9b66b8892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af96c3a8-9e86-49d5-8b2e-5574d5a9d97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:28 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume 0b8552bd-fe36-4c9f-9f4f-bc0213805126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126', 'volume_size': 1}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e" returned: 0 in 0.714s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:28 devstack sudo[90168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb 1G
Apr 27 15:17:28 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:28 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9689997e-4138-486b-8062-0af3760510e0" returned: 0 in 0.686s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-quobyte-9689997e-4138-486b-8062-0af3760510e0" released by "delete_volume" :: held 1.300s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:28 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Flow 'volume_create_manager' (8917b9e7-8745-4e06-970f-351e108c7cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb34ea20-d242-45da-9221-da3b9981c9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb34ea20-d242-45da-9221-da3b9981c9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1184313463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748e3dc1-1466-45ea-a9f0-2c33699f1b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b725c1c57de4937a78ca6a4d32bbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:29Z,use_quota=True,user_id='24d9f1e7f1b94a36b6e43eda50e6eb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003445ce-cf05-4ba1-96bd-763775cb24a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003445ce-cf05-4ba1-96bd-763775cb24a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (945c0a0c-b357-49ce-8155-15fe87c9ac17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (945c0a0c-b357-49ce-8155-15fe87c9ac17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748e3dc1-1466-45ea-a9f0-2c33699f1b04', 'volume_name': 'volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dc614b-d2d0-4d4e-9c08-1f48a39f9098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dc614b-d2d0-4d4e-9c08-1f48a39f9098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4141f4aa-326f-45c2-be80-86fef24b3ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:29 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume 748e3dc1-1466-45ea-a9f0-2c33699f1b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04', 'volume_size': 1}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Created reservations ['fc07aa6d-3c23-4774-8475-df8fa8f2851d', 'cf2980b9-be3d-49a0-b130-0cfabdb1ae80', '9bbad1fa-a94c-4d54-b976-ce6619afd286', '5e30cef8-4d44-401c-b96b-bbf1a3d8cecf'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:29 devstack sudo[90173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:29 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Flow 'volume_create_manager' (cfda4bc0-67db-4109-bffe-68e71fddf420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08901bfc-0733-4688-a7ef-d7f364a75c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08901bfc-0733-4688-a7ef-d7f364a75c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-841305443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a6ffc8-89a0-4303-bc9f-c361db967f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b725c1c57de4937a78ca6a4d32bbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:29Z,use_quota=True,user_id='24d9f1e7f1b94a36b6e43eda50e6eb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7645cc33-ece7-47ca-803b-b5ac0cd3b07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7645cc33-ece7-47ca-803b-b5ac0cd3b07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f63b4d7-1e6f-44e1-a797-256f3099ae3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f63b4d7-1e6f-44e1-a797-256f3099ae3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a6ffc8-89a0-4303-bc9f-c361db967f37', 'volume_name': 'volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2eae368-81ab-4310-8266-79ebd6251580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2eae368-81ab-4310-8266-79ebd6251580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898fb677-6c95-4786-acff-843718af6bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:29 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume f1a6ffc8-89a0-4303-bc9f-c361db967f37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37', 'volume_size': 1}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:29 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb 1G" returned: 0 in 1.023s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:29 devstack sudo[90176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb
Apr 27 15:17:29 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Flow 'volume_create_manager' (4e5a4951-ce58-4e71-a8be-b964b9943b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68748384-159b-482e-94a6-1aa6428c6263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68748384-159b-482e-94a6-1aa6428c6263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-608920002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce9de5d-340a-4b3f-b38d-22989ce6bae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b725c1c57de4937a78ca6a4d32bbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:30Z,use_quota=True,user_id='24d9f1e7f1b94a36b6e43eda50e6eb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:29 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46522dc3-4e68-47a9-9f69-896a20dd07b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46522dc3-4e68-47a9-9f69-896a20dd07b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94522dbd-40f7-464a-be29-958083495f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94522dbd-40f7-464a-be29-958083495f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce9de5d-340a-4b3f-b38d-22989ce6bae4', 'volume_name': 'volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0a7680-8d4f-408f-a8f0-b1b44558ec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0a7680-8d4f-408f-a8f0-b1b44558ec1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2119d64f-c44e-4776-9aa2-d6b82d337e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:30 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume 9ce9de5d-340a-4b3f-b38d-22989ce6bae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4', 'volume_size': 1}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "cinder-68d4b6ef-754f-47f8-8b61-07ae1f0a380a-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:30 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.924s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:30 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Deleted volume successfully.
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-68d4b6ef-754f-47f8-8b61-07ae1f0a380a-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e1a0c7e6-d5b7-41a7-a9a9-db6a7faf0bf7 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-9689997e-4138-486b-8062-0af3760510e0-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "cinder-quobyte-68d4b6ef-754f-47f8-8b61-07ae1f0a380a" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-quobyte-68d4b6ef-754f-47f8-8b61-07ae1f0a380a" acquired by "delete_volume" :: waited 0.024s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[33215ff2-1736-4db4-83f1-f3b77c5ddbe1]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:30 devstack sudo[90179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a
Apr 27 15:17:30 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Flow 'volume_create_manager' (ae8314cf-b9fe-4636-accf-fbacdf080ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bfb76f8-aac4-43f2-af1c-6fbfab961eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bfb76f8-aac4-43f2-af1c-6fbfab961eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-422680976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199e788f-bbd9-4ff4-8016-0377b252021c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b725c1c57de4937a78ca6a4d32bbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:30Z,use_quota=True,user_id='24d9f1e7f1b94a36b6e43eda50e6eb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce03220-2812-4132-ba71-843df9e1ffbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce03220-2812-4132-ba71-843df9e1ffbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4825b6d4-709f-4233-9b30-bc2e1338911c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4825b6d4-709f-4233-9b30-bc2e1338911c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '199e788f-bbd9-4ff4-8016-0377b252021c', 'volume_name': 'volume-199e788f-bbd9-4ff4-8016-0377b252021c', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9446b33-74fe-477c-b39e-6f8d9ff8ead0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9446b33-74fe-477c-b39e-6f8d9ff8ead0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dbbdb33-b5aa-46e2-848c-1bdbf74aaf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:30 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume 199e788f-bbd9-4ff4-8016-0377b252021c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-199e788f-bbd9-4ff4-8016-0377b252021c', 'volume_size': 1}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:30 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb" returned: 0 in 0.979s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:30 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb is being set with open permissions: ugo+rw
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:30 devstack sudo[90184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb
Apr 27 15:17:30 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:30 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a" returned: 0 in 0.648s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:30 devstack sudo[90189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a
Apr 27 15:17:30 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:31 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb" returned: 0 in 0.606s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:31 devstack sudo[90192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.info
Apr 27 15:17:31 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:31 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-68d4b6ef-754f-47f8-8b61-07ae1f0a380a" returned: 0 in 0.574s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-quobyte-68d4b6ef-754f-47f8-8b61-07ae1f0a380a" released by "delete_volume" :: held 1.296s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:31 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Created reservations ['79c6cd27-290c-4ca9-a7f7-cdd1b8a22320', 'd0e5349e-ee33-489d-a1a2-62b9657fc4ad', '94c6f1ec-f27f-4720-96dc-a02081fa99d1', '31a4d63e-c965-49b3-a25f-aef8264f8e3f'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:31 devstack sudo[90195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:31 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:31 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.info" returned: 0 in 0.561s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:31 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.info is being set with open permissions: ugo+rw
Apr 27 15:17:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:31 devstack sudo[90198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.info
Apr 27 15:17:31 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "cinder-5fac5214-224e-469e-9e09-05810873587b-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-5fac5214-224e-469e-9e09-05810873587b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:32 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "cinder-quobyte-5fac5214-224e-469e-9e09-05810873587b" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.674s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:32 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Deleted volume successfully.
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-quobyte-5fac5214-224e-469e-9e09-05810873587b" acquired by "delete_volume" :: waited 0.032s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0206261a-4d81-4420-b075-7b3d1eef4687 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-68d4b6ef-754f-47f8-8b61-07ae1f0a380a-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f607ba-4e27-46f3-ad10-de480da261b9]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5fac5214-224e-469e-9e09-05810873587b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:32 devstack sudo[90202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5fac5214-224e-469e-9e09-05810873587b
Apr 27 15:17:32 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:32 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.info" returned: 0 in 0.696s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.703s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.956s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-974659840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8552bd-fe36-4c9f-9f4f-bc0213805126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b725c1c57de4937a78ca6a4d32bbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:28Z,use_quota=True,user_id='24d9f1e7f1b94a36b6e43eda50e6eb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Creating volume 0b8552bd-fe36-4c9f-9f4f-bc0213805126 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:32 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:32 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-6a90961f-9427-4d2c-b881-d734947a06ed tempest-VolumeDependencyTests-1616645965 None] Create snapshot completed successfully
Apr 27 15:17:32 devstack sudo[90204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126 1073741824
Apr 27 15:17:32 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:33 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5fac5214-224e-469e-9e09-05810873587b" returned: 0 in 0.679s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5fac5214-224e-469e-9e09-05810873587b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:33 devstack sudo[90211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5fac5214-224e-469e-9e09-05810873587b
Apr 27 15:17:33 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:33 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126 1073741824" returned: 0 in 0.813s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:33 devstack sudo[90214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126
Apr 27 15:17:33 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:33 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-5fac5214-224e-469e-9e09-05810873587b" returned: 0 in 0.551s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:33 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-quobyte-5fac5214-224e-469e-9e09-05810873587b" released by "delete_volume" :: held 1.290s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:33 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Created reservations ['c84e2e21-8e81-4f4a-b188-e4720ebda257', '53f020f7-f9fa-4911-a629-7584df8a9cb8', '457e7295-6b7a-40e4-8a8d-76c4a5843157', '2421b11a-9683-4c29-a5c9-227d72df8559'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:33 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:33 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:33 devstack sudo[90223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:33 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Flow 'volume_create_manager' (ecf9339a-2767-40ee-89cb-f9a125d96c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cba9ff8-c481-4204-9364-3704e6b74446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cba9ff8-c481-4204-9364-3704e6b74446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-62763051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2a15b0-4090-47c5-828c-0bbcc5b6fce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb44773f6b34fa187bd8845c1fd33f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a74bb992-d636-41d7-9477-cf608f467ccb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:34Z,use_quota=True,user_id='9fa51d375b0a4804bc689bd9fc560dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c299cfda-1cdc-49c2-8acf-203352955469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c299cfda-1cdc-49c2-8acf-203352955469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94dd323b-5bd2-4329-975c-c92a277a0909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94dd323b-5bd2-4329-975c-c92a277a0909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dd2a15b0-4090-47c5-828c-0bbcc5b6fce3', 'volume_name': 'volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3', 'volume_size': 1, 'snapshot_id': 'a74bb992-d636-41d7-9477-cf608f467ccb'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95101f8-70ae-43de-99e9-f3c99ebe1aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95101f8-70ae-43de-99e9-f3c99ebe1aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b3769b-3e24-43e6-98c2-dabc8d1bc94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:34 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Volume dd2a15b0-4090-47c5-828c-0bbcc5b6fce3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3', 'volume_size': 1, 'snapshot_id': 'a74bb992-d636-41d7-9477-cf608f467ccb'}
Apr 27 15:17:34 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126" returned: 0 in 0.712s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.043s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1184313463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748e3dc1-1466-45ea-a9f0-2c33699f1b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b725c1c57de4937a78ca6a4d32bbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:29Z,use_quota=True,user_id='24d9f1e7f1b94a36b6e43eda50e6eb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Creating volume 748e3dc1-1466-45ea-a9f0-2c33699f1b04 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:34 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af96c3a8-9e86-49d5-8b2e-5574d5a9d97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a70d104-2d62-4b38-b722-2590a34a809a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:34 devstack sudo[90226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04 1073741824
Apr 27 15:17:34 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:34 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126 (0b8552bd-fe36-4c9f-9f4f-bc0213805126): created successfully
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a70d104-2d62-4b38-b722-2590a34a809a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Flow 'volume_create_manager' (3b23c95e-e472-4d84-8c67-5016df2ed81a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:34 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-39a4443a-95b5-4501-b787-b74b7d6a435c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Created volume successfully.
Apr 27 15:17:34 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.516s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:34 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Deleted volume successfully.
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6c63c65c-e6f4-431a-88f6-dbe8f9ff4cc2 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-5fac5214-224e-469e-9e09-05810873587b-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "cinder-96b741e9-615d-4204-a922-f0e544410fcf-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-96b741e9-615d-4204-a922-f0e544410fcf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "cinder-quobyte-96b741e9-615d-4204-a922-f0e544410fcf" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-quobyte-96b741e9-615d-4204-a922-f0e544410fcf" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52224de-73fb-45c4-9bb3-27f8664a4c86]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96b741e9-615d-4204-a922-f0e544410fcf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:34 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96b741e9-615d-4204-a922-f0e544410fcf
Apr 27 15:17:34 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Flow 'volume_create_manager' (41aa7d3e-0e92-4bf5-a21a-137d530067b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8d24da-e8be-4191-8e45-e66a55949b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8d24da-e8be-4191-8e45-e66a55949b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1905427598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6a51bdf6814ae2abc1e2f39a5e58a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:35Z,use_quota=True,user_id='a7a50819623c4d17b20e544e25a99283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431c2337-c5ba-4d8f-9f47-16f3707ec6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431c2337-c5ba-4d8f-9f47-16f3707ec6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:34 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03eac124-ea6f-4927-8d15-0bcefb2eac8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03eac124-ea6f-4927-8d15-0bcefb2eac8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd', 'volume_name': 'volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a467293-a246-4976-b1a9-e8b739e96170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a467293-a246-4976-b1a9-e8b739e96170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (230b8f3c-0856-41cf-a4ee-9da6a48284a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:34 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Volume 48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd', 'volume_size': 1}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04 1073741824" returned: 0 in 0.820s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:35 devstack sudo[90234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04
Apr 27 15:17:35 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:35 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96b741e9-615d-4204-a922-f0e544410fcf" returned: 0 in 0.606s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96b741e9-615d-4204-a922-f0e544410fcf {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:35 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96b741e9-615d-4204-a922-f0e544410fcf
Apr 27 15:17:35 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:35 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04" returned: 0 in 0.436s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.959s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-841305443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a6ffc8-89a0-4303-bc9f-c361db967f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b725c1c57de4937a78ca6a4d32bbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:29Z,use_quota=True,user_id='24d9f1e7f1b94a36b6e43eda50e6eb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Creating volume f1a6ffc8-89a0-4303-bc9f-c361db967f37 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:35 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4141f4aa-326f-45c2-be80-86fef24b3ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f14274-88ab-4789-beb3-7abe7fd3d978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:35 devstack sudo[90242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37 1073741824
Apr 27 15:17:35 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:35 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04 (748e3dc1-1466-45ea-a9f0-2c33699f1b04): created successfully
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f14274-88ab-4789-beb3-7abe7fd3d978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Flow 'volume_create_manager' (8917b9e7-8745-4e06-970f-351e108c7cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:35 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b010683a-1712-4d11-ae04-e600ccada046 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Created volume successfully.
Apr 27 15:17:35 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-96b741e9-615d-4204-a922-f0e544410fcf" returned: 0 in 0.472s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-quobyte-96b741e9-615d-4204-a922-f0e544410fcf" released by "delete_volume" :: held 1.132s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Created reservations ['a24e3105-3006-410d-9023-bf0aedb853b9', '13911a0e-21f4-4f11-b0bb-3c155422fcee', 'e3c46a0a-4d2f-40bd-9d32-0f551511305b', 'ea9b3de6-9615-4a29-b4fc-6a7e5cb684a4'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:35 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:35 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:36 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37 1073741824" returned: 0 in 0.690s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:36 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37
Apr 27 15:17:36 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:36 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.448s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:36 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Deleted volume successfully.
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-8fc6fb77-7158-4936-a343-a325386b0c08 tempest-CreateVolumesFromImageTest-1319075823 None] Lock "cinder-96b741e9-615d-4204-a922-f0e544410fcf-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:36 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37" returned: 0 in 0.470s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.626s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-608920002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce9de5d-340a-4b3f-b38d-22989ce6bae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b725c1c57de4937a78ca6a4d32bbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:30Z,use_quota=True,user_id='24d9f1e7f1b94a36b6e43eda50e6eb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Creating volume 9ce9de5d-340a-4b3f-b38d-22989ce6bae4 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:36 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898fb677-6c95-4786-acff-843718af6bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:36 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4 1073741824
Apr 27 15:17:36 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbb7dd9-dd1c-43fa-8700-4de8edc6b001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:36 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37 (f1a6ffc8-89a0-4303-bc9f-c361db967f37): created successfully
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbb7dd9-dd1c-43fa-8700-4de8edc6b001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:36 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Flow 'volume_create_manager' (cfda4bc0-67db-4109-bffe-68e71fddf420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:36 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-14baa6b6-f3ab-4e23-b9b1-bf0d8a2331ac tempest-CreateVolumesFromSnapshotTest-2053636260 None] Created volume successfully.
Apr 27 15:17:37 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4 1073741824" returned: 0 in 0.722s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:37 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4
Apr 27 15:17:37 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:37 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4" returned: 0 in 0.504s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.424s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-422680976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199e788f-bbd9-4ff4-8016-0377b252021c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b725c1c57de4937a78ca6a4d32bbe30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:30Z,use_quota=True,user_id='24d9f1e7f1b94a36b6e43eda50e6eb4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Creating volume 199e788f-bbd9-4ff4-8016-0377b252021c {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:37 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-199e788f-bbd9-4ff4-8016-0377b252021c 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:38 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-199e788f-bbd9-4ff4-8016-0377b252021c 1073741824
Apr 27 15:17:38 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2119d64f-c44e-4776-9aa2-d6b82d337e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee70453-e891-42e6-9d3f-346389d9e318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:38 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4 (9ce9de5d-340a-4b3f-b38d-22989ce6bae4): created successfully
Apr 27 15:17:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee70453-e891-42e6-9d3f-346389d9e318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:38 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Flow 'volume_create_manager' (4e5a4951-ce58-4e71-a8be-b964b9943b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:38 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-7240a2fd-49a5-4e24-8804-58dfc53a57ce tempest-CreateVolumesFromSnapshotTest-2053636260 None] Created volume successfully.
Apr 27 15:17:38 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-199e788f-bbd9-4ff4-8016-0377b252021c 1073741824" returned: 0 in 0.677s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-199e788f-bbd9-4ff4-8016-0377b252021c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:38 devstack sudo[90268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-199e788f-bbd9-4ff4-8016-0377b252021c
Apr 27 15:17:38 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:39 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Flow 'volume_create_manager' (ba45dc1b-e97c-4fa7-b642-9893539a9517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f87507-ed82-49ea-9c74-5fea13abbbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-199e788f-bbd9-4ff4-8016-0377b252021c" returned: 0 in 0.606s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.142s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-quobyte-a74bb992-d636-41d7-9477-cf608f467ccb-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3" by "_create_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f87507-ed82-49ea-9c74-5fea13abbbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-784462900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7784ad90-14e8-47af-92b8-9a3b22fb551a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ed2413713c401fb99f45eefada0b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:39Z,use_quota=True,user_id='01ad14c9cb784986b5000bd64ec5c2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c53434-b9c6-4ebe-b95d-ba349a6661a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c53434-b9c6-4ebe-b95d-ba349a6661a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65025cc-1a7b-4b05-8b68-3482c5d2eaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65025cc-1a7b-4b05-8b68-3482c5d2eaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7784ad90-14e8-47af-92b8-9a3b22fb551a', 'volume_name': 'volume-7784ad90-14e8-47af-92b8-9a3b22fb551a', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d883bc-7e85-4fe0-a812-a4c649184dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d883bc-7e85-4fe0-a812-a4c649184dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50730976-066b-4bdc-bd06-ea0dfb2b5709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:39 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume 7784ad90-14e8-47af-92b8-9a3b22fb551a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7784ad90-14e8-47af-92b8-9a3b22fb551a', 'volume_size': 1}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dbbdb33-b5aa-46e2-848c-1bdbf74aaf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-199e788f-bbd9-4ff4-8016-0377b252021c', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f28ed9-6c16-4df3-aa8c-cbbf3361ed87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-a74bb992-d636-41d7-9477-cf608f467ccb-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Creating volume dd2a15b0-4090-47c5-828c-0bbcc5b6fce3 from snapshot a74bb992-d636-41d7-9477-cf608f467ccb {{(pid=81538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-quobyte-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3" by "_copy_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:39 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Volume volume-199e788f-bbd9-4ff4-8016-0377b252021c (199e788f-bbd9-4ff4-8016-0377b252021c): created successfully
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f28ed9-6c16-4df3-aa8c-cbbf3361ed87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Flow 'volume_create_manager' (ae8314cf-b9fe-4636-accf-fbacdf080ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] snapshot: a74bb992-d636-41d7-9477-cf608f467ccb, volume: dd2a15b0-4090-47c5-828c-0bbcc5b6fce3,  {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:39 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-149e620f-6a21-440e-b047-8fd7062d539e tempest-CreateVolumesFromSnapshotTest-2053636260 None] Created volume successfully.
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[317a488d-17bf-4d6d-96bc-62ea7d196855]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:39 devstack sudo[90271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb
Apr 27 15:17:39 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:39 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb" returned: 0 in 0.508s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Creating direct copy from snapshot {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bff813f-d51f-427e-a985-88b179274ac6]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:39 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:40 devstack sudo[90276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e
Apr 27 15:17:40 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-199e788f-bbd9-4ff4-8016-0377b252021c-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-199e788f-bbd9-4ff4-8016-0377b252021c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-quobyte-199e788f-bbd9-4ff4-8016-0377b252021c" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:40 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-199e788f-bbd9-4ff4-8016-0377b252021c" acquired by "delete_volume" :: waited 0.013s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:40 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[826d7e59-8150-440d-99ff-f10660cdc02d]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-199e788f-bbd9-4ff4-8016-0377b252021c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:40 devstack sudo[90280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-199e788f-bbd9-4ff4-8016-0377b252021c
Apr 27 15:17:40 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:40 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e" returned: 0 in 0.567s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:40 devstack cinder-volume[81538]: DEBUG cinder.utils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Path /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3 not found in is_blk_device check {{(pid=81538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 27 15:17:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:40 devstack sudo[90283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3
Apr 27 15:17:40 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:40 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-199e788f-bbd9-4ff4-8016-0377b252021c" returned: 0 in 0.523s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:40 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-199e788f-bbd9-4ff4-8016-0377b252021c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:40 devstack sudo[90291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-199e788f-bbd9-4ff4-8016-0377b252021c
Apr 27 15:17:40 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:41 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:41 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-199e788f-bbd9-4ff4-8016-0377b252021c" returned: 0 in 0.885s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:41 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-199e788f-bbd9-4ff4-8016-0377b252021c" released by "delete_volume" :: held 1.464s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:41 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Created reservations ['27fdc7f3-26e6-4797-9834-f911424717e5', '0f1ff879-edf1-417e-9c51-68137cdd1563', '4d853024-143f-4b14-bb3b-8c9c380f0490', 'c8ef80cc-dde0-432b-bc78-d52fc063dae7'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:42 devstack sudo[90301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:42 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-9ce9de5d-340a-4b3f-b38d-22989ce6bae4-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-9ce9de5d-340a-4b3f-b38d-22989ce6bae4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-quobyte-9ce9de5d-340a-4b3f-b38d-22989ce6bae4" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-9ce9de5d-340a-4b3f-b38d-22989ce6bae4" acquired by "delete_volume" :: waited 0.026s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:42 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[398d943d-aedf-4014-90ea-b3ff0a9e39f6]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.747s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:42 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Deleted volume successfully.
Apr 27 15:17:42 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b23627fd-a71b-45d5-8339-6bcafdf2269d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-199e788f-bbd9-4ff4-8016-0377b252021c-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:43 devstack sudo[90304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4
Apr 27 15:17:43 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:43 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4" returned: 0 in 0.934s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:43 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:43 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4
Apr 27 15:17:43 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:44 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:44 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-9ce9de5d-340a-4b3f-b38d-22989ce6bae4" returned: 0 in 1.116s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:44 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-9ce9de5d-340a-4b3f-b38d-22989ce6bae4" released by "delete_volume" :: held 2.145s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:44 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Created reservations ['00388d7c-d2a0-4641-b283-703073e9a983', '2b2d660c-55fc-4382-a94b-a91c2f5fd0d9', '61463c8c-1d2a-4188-86ce-0764028c156e', 'e7ffecef-ea2e-4189-841b-5aeef8b259f3'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:45 devstack sudo[90312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:45 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-f1a6ffc8-89a0-4303-bc9f-c361db967f37-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-f1a6ffc8-89a0-4303-bc9f-c361db967f37-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-quobyte-f1a6ffc8-89a0-4303-bc9f-c361db967f37" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-f1a6ffc8-89a0-4303-bc9f-c361db967f37" acquired by "delete_volume" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[431f044c-c461-44b3-afb9-5afbd168f26a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:45 devstack sudo[90314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37
Apr 27 15:17:45 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:45 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3" returned: 0 in 5.435s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b15624-1c2b-41a5-a9b7-e7b3aede8dae]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:45 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:46 devstack sudo[90316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e
Apr 27 15:17:46 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:46 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.947s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:46 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Deleted volume successfully.
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-43616c23-b3a4-4e4d-8527-167f972e926c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-9ce9de5d-340a-4b3f-b38d-22989ce6bae4-delete_volume" released by "delete_volume" :: held 3.449s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:46 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37" returned: 0 in 0.815s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:46 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37
Apr 27 15:17:46 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:46 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e" returned: 0 in 0.685s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3 {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:17:46 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Converted 1024.00 MB image at 188.38 MB/s
Apr 27 15:17:46 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3 is being set with open permissions: ugo+rw
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:46 devstack sudo[90328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3
Apr 27 15:17:46 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:46 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f1a6ffc8-89a0-4303-bc9f-c361db967f37" returned: 0 in 0.516s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-f1a6ffc8-89a0-4303-bc9f-c361db967f37" released by "delete_volume" :: held 1.409s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Created reservations ['ea2465c7-11d2-4dc4-9707-f2cab781c27d', '627bc3b9-61f9-45c9-bf24-4d7b4b273456', '5d0cf686-5ce8-4b96-9a73-86ec3ca8f9eb', 'b301d9c5-0b0c-4017-8092-0960102c4e85'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:46 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:47 devstack sudo[90330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:47 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:47 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3" returned: 0 in 0.474s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3" released by "_copy_volume_from_snapshot" :: held 7.765s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-a74bb992-d636-41d7-9477-cf608f467ccb-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3" released by "_create_volume_from_snapshot" :: held 7.808s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.876s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.215s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1905427598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6a51bdf6814ae2abc1e2f39a5e58a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:35Z,use_quota=True,user_id='a7a50819623c4d17b20e544e25a99283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Creating volume 48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:47 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:47 devstack sudo[90333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd 1073741824
Apr 27 15:17:47 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b3769b-3e24-43e6-98c2-dabc8d1bc94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3', 'volume_size': 1, 'snapshot_id': 'a74bb992-d636-41d7-9477-cf608f467ccb'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2061b671-5224-4dcb-83d7-933ddbdec38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:47 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Volume volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3 (dd2a15b0-4090-47c5-828c-0bbcc5b6fce3): created successfully
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2061b671-5224-4dcb-83d7-933ddbdec38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Flow 'volume_create_manager' (ecf9339a-2767-40ee-89cb-f9a125d96c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:47 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b5698755-3d31-475f-b259-8e716b40c585 tempest-VolumeDependencyTests-1616645965 None] Created volume successfully.
Apr 27 15:17:47 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.443s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:47 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Deleted volume successfully.
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e20e3d2c-5c1f-425d-b2ce-91373f58ea00 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-f1a6ffc8-89a0-4303-bc9f-c361db967f37-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-748e3dc1-1466-45ea-a9f0-2c33699f1b04-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-748e3dc1-1466-45ea-a9f0-2c33699f1b04-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-quobyte-748e3dc1-1466-45ea-a9f0-2c33699f1b04" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-748e3dc1-1466-45ea-a9f0-2c33699f1b04" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2e9883-fe46-439d-9d4a-c4a15315225d]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:47 devstack sudo[90339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04
Apr 27 15:17:47 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:47 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd 1073741824" returned: 0 in 0.690s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:47 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:47 devstack sudo[90341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd
Apr 27 15:17:47 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-a74bb992-d636-41d7-9477-cf608f467ccb-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-a74bb992-d636-41d7-9477-cf608f467ccb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-quobyte-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-quobyte-a74bb992-d636-41d7-9477-cf608f467ccb" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-a74bb992-d636-41d7-9477-cf608f467ccb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Deleting offline snapshot a74bb992-d636-41d7-9477-cf608f467ccb of volume e5a59ff4-7b1d-4c7c-b726-9dc521d3308e {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] snapshot_file for this snap is: volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[658933b8-5487-4e2a-b50b-e11072626ebc]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:48 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04" returned: 0 in 0.592s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:48 devstack sudo[90346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb
Apr 27 15:17:48 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:48 devstack sudo[90348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04
Apr 27 15:17:48 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:48 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd" returned: 0 in 0.528s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.104s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-784462900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7784ad90-14e8-47af-92b8-9a3b22fb551a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ed2413713c401fb99f45eefada0b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:39Z,use_quota=True,user_id='01ad14c9cb784986b5000bd64ec5c2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Creating volume 7784ad90-14e8-47af-92b8-9a3b22fb551a {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:48 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7784ad90-14e8-47af-92b8-9a3b22fb551a 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (230b8f3c-0856-41cf-a4ee-9da6a48284a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:48 devstack sudo[90352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7784ad90-14e8-47af-92b8-9a3b22fb551a 1073741824
Apr 27 15:17:48 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba772a64-cfef-4357-bff1-eee38c1ab4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:48 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Volume volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd (48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd): created successfully
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba772a64-cfef-4357-bff1-eee38c1ab4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Flow 'volume_create_manager' (41aa7d3e-0e92-4bf5-a21a-137d530067b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:48 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-d246247f-3d04-4427-b936-5eee4f202a01 tempest-SnapshotDependencyTests-774792045 None] Created volume successfully.
Apr 27 15:17:48 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb" returned: 0 in 0.565s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:17:48 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-748e3dc1-1466-45ea-a9f0-2c33699f1b04" returned: 0 in 0.516s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[32911ddd-ad24-46d6-9bdc-8de73abe0345]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-748e3dc1-1466-45ea-a9f0-2c33699f1b04" released by "delete_volume" :: held 1.162s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_service.periodic_task [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81538) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:48 devstack sudo[90361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:48 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:48 devstack sudo[90358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e
Apr 27 15:17:48 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Created reservations ['67d477f6-77b0-48ae-acc2-aa97fba63b52', '83f7f630-cd53-42db-ba06-e016f18f555b', '0bfc8034-fe6a-40fa-bf78-b0b4521a3bc0', '8f20fee2-4825-4392-b311-b14677656e2a'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:49 devstack sudo[90365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:49 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:49 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7784ad90-14e8-47af-92b8-9a3b22fb551a 1073741824" returned: 0 in 0.674s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7784ad90-14e8-47af-92b8-9a3b22fb551a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:49 devstack sudo[90367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7784ad90-14e8-47af-92b8-9a3b22fb551a
Apr 27 15:17:49 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:49 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.685s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:49 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.601s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:49 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Deleted volume successfully.
Apr 27 15:17:49 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e" returned: 0 in 0.799s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-1ba5af8d-4560-487c-bfae-0c28dc397280 tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-748e3dc1-1466-45ea-a9f0-2c33699f1b04-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:49 devstack sudo[90374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb
Apr 27 15:17:49 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-0b8552bd-fe36-4c9f-9f4f-bc0213805126-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:49 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7784ad90-14e8-47af-92b8-9a3b22fb551a" returned: 0 in 0.666s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.293s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-0b8552bd-fe36-4c9f-9f4f-bc0213805126-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] Creating offline snapshot bdc07975-d515-44a8-9c7f-db03c72dd23e of volume 48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50730976-066b-4bdc-bd06-ea0dfb2b5709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7784ad90-14e8-47af-92b8-9a3b22fb551a', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ac3647-6c50-45c1-83c1-d1b2743e2b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22ad6a2-4c03-4185-9e05-4724a3db1841]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:49 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume volume-7784ad90-14e8-47af-92b8-9a3b22fb551a (7784ad90-14e8-47af-92b8-9a3b22fb551a): created successfully
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ac3647-6c50-45c1-83c1-d1b2743e2b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Flow 'volume_create_manager' (ba45dc1b-e97c-4fa7-b642-9893539a9517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-quobyte-0b8552bd-fe36-4c9f-9f4f-bc0213805126" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:49 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-a49c56bd-a7cc-489d-a901-e54d34ec4323 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Created volume successfully.
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-0b8552bd-fe36-4c9f-9f4f-bc0213805126" acquired by "delete_volume" :: waited 0.028s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57e54a4-da35-4117-bbfd-d12f269c8ed5]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:50 devstack sudo[90377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd
Apr 27 15:17:50 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:50 devstack sudo[90378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126
Apr 27 15:17:50 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:50 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb" returned: 0 in 0.624s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:50 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb
Apr 27 15:17:50 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:50 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd" returned: 0 in 0.720s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Flow 'volume_create_manager' (1bb427d9-70af-47fb-9bfb-78f52dfd4ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9619fe8-b693-42bf-8759-3fc4a4255fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:50 devstack sudo[90392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e 1G
Apr 27 15:17:50 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9619fe8-b693-42bf-8759-3fc4a4255fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-106367683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ecc75f-7b2f-453c-9e97-716c1ca08a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ed2413713c401fb99f45eefada0b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:51Z,use_quota=True,user_id='01ad14c9cb784986b5000bd64ec5c2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480c09e0-6035-44ba-8142-119bbe158f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480c09e0-6035-44ba-8142-119bbe158f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89a3317-35d7-4087-a50a-fb09679a9fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89a3317-35d7-4087-a50a-fb09679a9fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ecc75f-7b2f-453c-9e97-716c1ca08a5f', 'volume_name': 'volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee5eab5-2a49-4829-901e-fced8217cd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee5eab5-2a49-4829-901e-fced8217cd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac019e7f-bb6a-4d4f-b8bd-7e87c79158fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:50 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume d2ecc75f-7b2f-453c-9e97-716c1ca08a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f', 'volume_size': 1}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:50 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126" returned: 0 in 0.787s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:50 devstack sudo[90395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126
Apr 27 15:17:50 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:50 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e.a74bb992-d636-41d7-9477-cf608f467ccb" returned: 0 in 0.587s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-a74bb992-d636-41d7-9477-cf608f467ccb" released by "_delete_snapshot" :: held 2.693s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e" released by "delete_snapshot" :: held 2.734s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Flow 'volume_create_manager' (e4034138-5a19-4a59-aadc-aaa245d904bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138032f2-53f1-4d98-8cde-7172f8f1cabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138032f2-53f1-4d98-8cde-7172f8f1cabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-833947755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0146d8e-bc5d-4059-9399-44c3d96bc3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ed2413713c401fb99f45eefada0b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:51Z,use_quota=True,user_id='01ad14c9cb784986b5000bd64ec5c2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f498200-22e8-4d51-8e43-e0a87d3b3a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:50 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f498200-22e8-4d51-8e43-e0a87d3b3a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737bcc83-c0a1-4593-8e6d-dec5ea718617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737bcc83-c0a1-4593-8e6d-dec5ea718617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0146d8e-bc5d-4059-9399-44c3d96bc3b6', 'volume_name': 'volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660de695-0c09-41eb-8e6e-964e79d2095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660de695-0c09-41eb-8e6e-964e79d2095d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed92583d-c948-4ee4-9884-4374410a3317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume f0146d8e-bc5d-4059-9399-44c3d96bc3b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6', 'volume_size': 1}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Created reservations ['e18fffbd-40cd-4ac4-b0f7-d1a21ef3facd', '46019c09-ab2d-46d7-9979-4928e15bf157', '15a07e9b-7236-4d55-87f9-c9cc0cc6852b', '63ccf019-f529-40c1-ad70-f05437b5ef33'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:51 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Delete snapshot completed successfully.
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-5e09af07-6dd6-4598-b970-26fd82777ea8 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-a74bb992-d636-41d7-9477-cf608f467ccb-delete_snapshot" released by "delete_snapshot" :: held 3.000s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Flow 'volume_create_manager' (5ca6e079-edab-4bbd-83ad-b188fa8bacf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001033ba-04b1-4f05-aae7-ef64b065c0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001033ba-04b1-4f05-aae7-ef64b065c0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2129484173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a41595-f87c-41f3-a1c3-4e05f2906774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ed2413713c401fb99f45eefada0b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:51Z,use_quota=True,user_id='01ad14c9cb784986b5000bd64ec5c2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca676d2-9aa4-49f0-8265-f3e5230b58f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca676d2-9aa4-49f0-8265-f3e5230b58f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98cb85a-724b-4928-8a84-0f0075555e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98cb85a-724b-4928-8a84-0f0075555e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a41595-f87c-41f3-a1c3-4e05f2906774', 'volume_name': 'volume-03a41595-f87c-41f3-a1c3-4e05f2906774', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0abac7f-75f4-40fd-95f3-deaea009366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0abac7f-75f4-40fd-95f3-deaea009366a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f906a311-86d9-4742-9ac4-2a2c05d7672e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume 03a41595-f87c-41f3-a1c3-4e05f2906774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a41595-f87c-41f3-a1c3-4e05f2906774', 'volume_size': 1}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:51 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-quobyte-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-0b8552bd-fe36-4c9f-9f4f-bc0213805126" returned: 0 in 0.653s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-0b8552bd-fe36-4c9f-9f4f-bc0213805126" released by "delete_volume" :: held 1.493s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e" acquired by "delete_volume" :: waited 0.044s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9de22e8-9272-401c-9619-5e434d0b24dd]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:51 devstack sudo[90401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e
Apr 27 15:17:51 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Flow 'volume_create_manager' (2cbc9f30-0323-4084-b37a-76497d2288a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb10902e-b696-490a-8e42-02024b58308d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb10902e-b696-490a-8e42-02024b58308d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1779140840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78033dd5-c300-4930-8ced-0777a4ebcf8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ed2413713c401fb99f45eefada0b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:52Z,use_quota=True,user_id='01ad14c9cb784986b5000bd64ec5c2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:51 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19795cf2-1b5b-490f-9a5c-e744133fe294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19795cf2-1b5b-490f-9a5c-e744133fe294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3757742a-12d5-4386-9dd1-7324a57cf96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3757742a-12d5-4386-9dd1-7324a57cf96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78033dd5-c300-4930-8ced-0777a4ebcf8b', 'volume_name': 'volume-78033dd5-c300-4930-8ced-0777a4ebcf8b', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e3b2fc-47c6-44e8-bc23-0ab85b984668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e3b2fc-47c6-44e8-bc23-0ab85b984668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66756666-e0d8-4200-8f2b-9258ffab32fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume 78033dd5-c300-4930-8ced-0777a4ebcf8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78033dd5-c300-4930-8ced-0777a4ebcf8b', 'volume_size': 1}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e 1G" returned: 0 in 1.112s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Created reservations ['c0c940a8-285f-4d7d-8976-a7e0ac0519c2', 'c2cde40c-16a0-4c74-acbe-e1368ab561a3', 'ec232ac3-0119-46e5-8e1e-c3629160fa95', '58db18de-a1e9-4d8c-8086-019fa0bff273'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:51 devstack sudo[90403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e
Apr 27 15:17:51 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:51 devstack sudo[90405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:51 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Flow 'volume_create_manager' (55204bb2-21a8-4763-910a-12592c483194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7869bd07-6c51-41b3-83a3-32d4796ac70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7869bd07-6c51-41b3-83a3-32d4796ac70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-386232925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3fe10b-458d-4b42-b5a0-7542142c0bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ed2413713c401fb99f45eefada0b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:52Z,use_quota=True,user_id='01ad14c9cb784986b5000bd64ec5c2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f66bec-81ce-420a-ae7b-d750150cfeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:51 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f66bec-81ce-420a-ae7b-d750150cfeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d76308-d843-4e7f-9018-0b5aed833e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d76308-d843-4e7f-9018-0b5aed833e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3fe10b-458d-4b42-b5a0-7542142c0bc1', 'volume_name': 'volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32475ee-827f-45a4-8a18-e68f530c28a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32475ee-827f-45a4-8a18-e68f530c28a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9133ad0e-7861-4f25-b700-af39d17428ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:52 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume de3fe10b-458d-4b42-b5a0-7542142c0bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1', 'volume_size': 1}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-7b9b6b18-8f6b-47da-8a51-42f834aad8a6-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-7b9b6b18-8f6b-47da-8a51-42f834aad8a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-quobyte-dd8e1432-73bc-43bc-bb06-6666fce716d1" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-dd8e1432-73bc-43bc-bb06-6666fce716d1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-quobyte-7b9b6b18-8f6b-47da-8a51-42f834aad8a6" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-7b9b6b18-8f6b-47da-8a51-42f834aad8a6" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Deleting offline snapshot 7b9b6b18-8f6b-47da-8a51-42f834aad8a6 of volume dd8e1432-73bc-43bc-bb06-6666fce716d1 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] snapshot_file for this snap is: volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ad841e-8f07-4fec-8914-79bd17f304cb]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:52 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6
Apr 27 15:17:52 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:52 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e" returned: 0 in 0.777s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:52 devstack sudo[90415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e
Apr 27 15:17:52 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:52 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e" returned: 0 in 0.701s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:52 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e is being set with open permissions: ugo+rw
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:52 devstack sudo[90418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e
Apr 27 15:17:52 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:52 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.724s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:52 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Deleted volume successfully.
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-224894d4-1272-44cf-b8eb-40530c54593f tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-0b8552bd-fe36-4c9f-9f4f-bc0213805126-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:52 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6" returned: 0 in 0.611s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8e1432-73bc-43bc-bb06-6666fce716d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c60324-7f16-4826-9f77-c8d9bbd19383]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:52 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e" returned: 0 in 0.547s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e" released by "delete_volume" :: held 1.422s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:52 devstack sudo[90425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1
Apr 27 15:17:52 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:52 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e" returned: 0 in 0.534s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:52 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Created reservations ['4d3d66c4-96f1-465b-9223-4fa1eb10f265', '7534d964-a4ba-452e-b66f-53cf70771eec', '9849f138-8172-4b33-8974-9968dfc5c80b', '3ff19223-55a7-44ec-ab4c-7ade861256e4'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:53 devstack sudo[90428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.info
Apr 27 15:17:53 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:53 devstack sudo[90430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:53 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:53 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1" returned: 0 in 0.520s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:53 devstack sudo[90435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6
Apr 27 15:17:53 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:53 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.info" returned: 0 in 0.474s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:53 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.info is being set with open permissions: ugo+rw
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:53 devstack sudo[90439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.info
Apr 27 15:17:53 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:53 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.557s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:53 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Deleted volume successfully.
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-0df8f4a7-48e7-4b59-9edf-956775f6d245 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-e5a59ff4-7b1d-4c7c-b726-9dc521d3308e-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:53 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Flow 'volume_create_manager' (1280e341-c6da-4e41-a8c6-b03e6e5b3c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326c8c65-5ffe-48ff-b0ae-48acc9530c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326c8c65-5ffe-48ff-b0ae-48acc9530c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1540129164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea3faa1-f832-4b58-842a-ead9b36d603c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb44773f6b34fa187bd8845c1fd33f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:54Z,use_quota=True,user_id='9fa51d375b0a4804bc689bd9fc560dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86556fa-8b0c-4047-a413-1e20d890a228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86556fa-8b0c-4047-a413-1e20d890a228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:54 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046e3396-737e-478e-ab01-9ba32aa9630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046e3396-737e-478e-ab01-9ba32aa9630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea3faa1-f832-4b58-842a-ead9b36d603c', 'volume_name': 'volume-aea3faa1-f832-4b58-842a-ead9b36d603c', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb083d52-e6b4-4a02-acba-85ebf510f785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb083d52-e6b4-4a02-acba-85ebf510f785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a5749b-0da7-42bd-bc43-6a5709f33176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:54 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Volume aea3faa1-f832-4b58-842a-ead9b36d603c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea3faa1-f832-4b58-842a-ead9b36d603c', 'volume_size': 1}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6" returned: 0 in 0.713s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:54 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.info" returned: 0 in 0.600s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:54 devstack sudo[90445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6
Apr 27 15:17:54 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.260s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.358s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-106367683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ecc75f-7b2f-453c-9e97-716c1ca08a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ed2413713c401fb99f45eefada0b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:51Z,use_quota=True,user_id='01ad14c9cb784986b5000bd64ec5c2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Creating volume d2ecc75f-7b2f-453c-9e97-716c1ca08a5f {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:54 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:54 devstack sudo[90447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f 1073741824
Apr 27 15:17:54 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:54 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b1ad51ad-d4d4-4353-b3ee-fe2da2831de6 tempest-SnapshotDependencyTests-774792045 None] Create snapshot completed successfully
Apr 27 15:17:54 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1.7b9b6b18-8f6b-47da-8a51-42f834aad8a6" returned: 0 in 0.528s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-7b9b6b18-8f6b-47da-8a51-42f834aad8a6" released by "_delete_snapshot" :: held 2.484s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-dd8e1432-73bc-43bc-bb06-6666fce716d1" released by "delete_snapshot" :: held 2.526s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Created reservations ['dec52395-235e-42a8-98aa-3f5ef2a5eb27', '4021993b-d14f-4529-b1cf-b41f0a58c0f0', '66cf3f07-d115-40af-983b-c0a1e929b4f8', '89ad359a-9088-4735-87c0-93b4db236a00'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:54 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:54 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Delete snapshot completed successfully.
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f 1073741824" returned: 0 in 0.657s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-077786b6-d788-447d-af0f-0b78c5584b5c tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-7b9b6b18-8f6b-47da-8a51-42f834aad8a6-delete_snapshot" released by "delete_snapshot" :: held 2.675s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:54 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:54 devstack sudo[90453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f
Apr 27 15:17:54 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Flow 'volume_create_manager' (196656fa-d7d5-42af-99da-da1174d8a85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ec5a84-13c1-47d7-ba5c-bcc8c34f6f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ec5a84-13c1-47d7-ba5c-bcc8c34f6f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d32ca3-e8f3-4346-adb3-2b969e7efccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6a51bdf6814ae2abc1e2f39a5e58a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bdc07975-d515-44a8-9c7f-db03c72dd23e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:55Z,use_quota=True,user_id='a7a50819623c4d17b20e544e25a99283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee4d813-c8e3-4001-a00f-b88da59b737e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee4d813-c8e3-4001-a00f-b88da59b737e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c37a78-67c8-4eec-b107-79dc3e7de714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c37a78-67c8-4eec-b107-79dc3e7de714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b6d32ca3-e8f3-4346-adb3-2b969e7efccd', 'volume_name': 'volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd', 'volume_size': 1, 'snapshot_id': 'bdc07975-d515-44a8-9c7f-db03c72dd23e'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268a3e5d-14e2-4b8d-8e74-88a6f25b5dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268a3e5d-14e2-4b8d-8e74-88a6f25b5dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a7f03a-b359-4e40-9769-a6956fe33edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:55 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Volume b6d32ca3-e8f3-4346-adb3-2b969e7efccd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd', 'volume_size': 1, 'snapshot_id': 'bdc07975-d515-44a8-9c7f-db03c72dd23e'}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-dd8e1432-73bc-43bc-bb06-6666fce716d1-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-dd8e1432-73bc-43bc-bb06-6666fce716d1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:55 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f" returned: 0 in 0.547s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.330s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-833947755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0146d8e-bc5d-4059-9399-44c3d96bc3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ed2413713c401fb99f45eefada0b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:51Z,use_quota=True,user_id='01ad14c9cb784986b5000bd64ec5c2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Creating volume f0146d8e-bc5d-4059-9399-44c3d96bc3b6 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:55 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:55 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6 1073741824
Apr 27 15:17:55 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "cinder-quobyte-dd8e1432-73bc-43bc-bb06-6666fce716d1" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac019e7f-bb6a-4d4f-b8bd-7e87c79158fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a2a79c-a764-44f3-b568-755000e239de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:55 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f (d2ecc75f-7b2f-453c-9e97-716c1ca08a5f): created successfully
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a2a79c-a764-44f3-b568-755000e239de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Flow 'volume_create_manager' (1bb427d9-70af-47fb-9bfb-78f52dfd4ad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-dd8e1432-73bc-43bc-bb06-6666fce716d1" acquired by "delete_volume" :: waited 0.046s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:17:55 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-74b36beb-c99a-4b88-952c-3ac3fa7446dd tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Created volume successfully.
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[45388cea-3504-4548-9376-fc5c11c3dbb4]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:17:55 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:55 devstack sudo[90458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1
Apr 27 15:17:55 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:56 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6 1073741824" returned: 0 in 0.654s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:56 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1" returned: 0 in 0.582s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:56 devstack sudo[90466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6
Apr 27 15:17:56 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:56 devstack sudo[90467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1
Apr 27 15:17:56 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:56 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6" returned: 0 in 0.461s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:56 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.217s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2129484173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a41595-f87c-41f3-a1c3-4e05f2906774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ed2413713c401fb99f45eefada0b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:51Z,use_quota=True,user_id='01ad14c9cb784986b5000bd64ec5c2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Creating volume 03a41595-f87c-41f3-a1c3-4e05f2906774 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:56 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-03a41595-f87c-41f3-a1c3-4e05f2906774 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd8e1432-73bc-43bc-bb06-6666fce716d1" returned: 0 in 0.476s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:56 devstack sudo[90472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-03a41595-f87c-41f3-a1c3-4e05f2906774 1073741824
Apr 27 15:17:56 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed92583d-c948-4ee4-9884-4374410a3317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a38e51e-e435-4158-82a4-e1568d2913b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-quobyte-dd8e1432-73bc-43bc-bb06-6666fce716d1" released by "delete_volume" :: held 1.136s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:56 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6 (f0146d8e-bc5d-4059-9399-44c3d96bc3b6): created successfully
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a38e51e-e435-4158-82a4-e1568d2913b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Flow 'volume_create_manager' (e4034138-5a19-4a59-aadc-aaa245d904bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:56 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-483dfb9c-2833-4c2c-a763-db3accf263b1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Created volume successfully.
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Created reservations ['691b4425-e01b-4e17-b4cb-56b0c9581ed7', '96cb8dec-a0c1-4f45-a1fe-6daef0da31a8', '66d17a85-a30d-4dcf-8cb7-e0e17e6d49b4', 'eab9586d-5584-4a64-8260-1824dd2029c1'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:56 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:56 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:17:56 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:57 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-03a41595-f87c-41f3-a1c3-4e05f2906774 1073741824" returned: 0 in 0.667s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:57 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.503s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:17:57 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Deleted volume successfully.
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-03a41595-f87c-41f3-a1c3-4e05f2906774 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-6f91d791-5789-4755-952b-e83b07afc43d tempest-CreateVolumesFromSnapshotTest-2053636260 None] Lock "cinder-dd8e1432-73bc-43bc-bb06-6666fce716d1-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:17:57 devstack sudo[90482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-03a41595-f87c-41f3-a1c3-4e05f2906774
Apr 27 15:17:57 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:57 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-03a41595-f87c-41f3-a1c3-4e05f2906774" returned: 0 in 0.483s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.019s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1779140840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78033dd5-c300-4930-8ced-0777a4ebcf8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ed2413713c401fb99f45eefada0b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:52Z,use_quota=True,user_id='01ad14c9cb784986b5000bd64ec5c2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Creating volume 78033dd5-c300-4930-8ced-0777a4ebcf8b {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:57 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-78033dd5-c300-4930-8ced-0777a4ebcf8b 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f906a311-86d9-4742-9ac4-2a2c05d7672e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a41595-f87c-41f3-a1c3-4e05f2906774', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:57 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-78033dd5-c300-4930-8ced-0777a4ebcf8b 1073741824
Apr 27 15:17:57 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b2cedb-9a1b-4357-a6e9-1d64b6a79bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:57 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume volume-03a41595-f87c-41f3-a1c3-4e05f2906774 (03a41595-f87c-41f3-a1c3-4e05f2906774): created successfully
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b2cedb-9a1b-4357-a6e9-1d64b6a79bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:57 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Flow 'volume_create_manager' (5ca6e079-edab-4bbd-83ad-b188fa8bacf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:57 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-1faf5d8f-ed4c-432a-aefe-e15c9c4e6bca tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Created volume successfully.
Apr 27 15:17:58 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-78033dd5-c300-4930-8ced-0777a4ebcf8b 1073741824" returned: 0 in 0.785s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:58 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-78033dd5-c300-4930-8ced-0777a4ebcf8b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:58 devstack sudo[90492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-78033dd5-c300-4930-8ced-0777a4ebcf8b
Apr 27 15:17:58 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:59 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-78033dd5-c300-4930-8ced-0777a4ebcf8b" returned: 0 in 0.518s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.080s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-386232925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3fe10b-458d-4b42-b5a0-7542142c0bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ed2413713c401fb99f45eefada0b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:52Z,use_quota=True,user_id='01ad14c9cb784986b5000bd64ec5c2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Creating volume de3fe10b-458d-4b42-b5a0-7542142c0bc1 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:17:59 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66756666-e0d8-4200-8f2b-9258ffab32fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78033dd5-c300-4930-8ced-0777a4ebcf8b', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:59 devstack sudo[90495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1 1073741824
Apr 27 15:17:59 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afcf11a-6d66-4584-be0d-b15a472c1674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:17:59 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume volume-78033dd5-c300-4930-8ced-0777a4ebcf8b (78033dd5-c300-4930-8ced-0777a4ebcf8b): created successfully
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afcf11a-6d66-4584-be0d-b15a472c1674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Flow 'volume_create_manager' (2cbc9f30-0323-4084-b37a-76497d2288a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:17:59 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-c9888baa-ead9-4a77-bb05-6e897015d113 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Created volume successfully.
Apr 27 15:17:59 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1 1073741824" returned: 0 in 0.748s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:17:59 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:17:59 devstack sudo[90500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1
Apr 27 15:17:59 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Flow 'volume_create_manager' (996cb2f6-2d2c-4048-884a-c9243fbd1c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773592b6-53b9-4d9b-a63e-0fe9bf3af158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773592b6-53b9-4d9b-a63e-0fe9bf3af158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a768bbca7dde42fe838cf54ba9928b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:18:00Z,use_quota=True,user_id='9ce6a8a5265c42eab56499e2c00a2d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ebf46b4-f8ab-4bd6-835c-accd41302c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ebf46b4-f8ab-4bd6-835c-accd41302c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f9992e-9b31-4b73-a95e-93a353a95529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f9992e-9b31-4b73-a95e-93a353a95529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0', 'volume_name': 'volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0831c3ab-d3c2-4132-bb4a-0c7ecaaba11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0831c3ab-d3c2-4132-bb4a-0c7ecaaba11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcbdcb67-9dd8-49df-9ccc-5f06585c267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:00 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Volume a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0', 'volume_size': 1}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:00 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1" returned: 0 in 0.479s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.298s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1540129164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea3faa1-f832-4b58-842a-ead9b36d603c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb44773f6b34fa187bd8845c1fd33f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:17:54Z,use_quota=True,user_id='9fa51d375b0a4804bc689bd9fc560dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Creating volume aea3faa1-f832-4b58-842a-ead9b36d603c {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:18:00 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9133ad0e-7861-4f25-b700-af39d17428ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4841b72e-743b-4ba6-a8ca-099dd9f0da4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:00 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c 1073741824
Apr 27 15:18:00 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Volume volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1 (de3fe10b-458d-4b42-b5a0-7542142c0bc1): created successfully
Apr 27 15:18:00 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4841b72e-743b-4ba6-a8ca-099dd9f0da4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Flow 'volume_create_manager' (55204bb2-21a8-4763-910a-12592c483194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:18:00 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-100c7639-c8ba-4482-abdd-6a4d8e7d2c27 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Created volume successfully.
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "cinder-de3fe10b-458d-4b42-b5a0-7542142c0bc1-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-de3fe10b-458d-4b42-b5a0-7542142c0bc1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "cinder-quobyte-de3fe10b-458d-4b42-b5a0-7542142c0bc1" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-quobyte-de3fe10b-458d-4b42-b5a0-7542142c0bc1" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[870b7050-911d-44c5-a87d-0802b3d01c6c]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:00 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:00 devstack sudo[90542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1
Apr 27 15:18:00 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:01 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c 1073741824" returned: 0 in 0.655s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:01 devstack sudo[90544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c
Apr 27 15:18:01 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:01 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1" returned: 0 in 0.570s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:01 devstack sudo[90550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1
Apr 27 15:18:01 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:01 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c" returned: 0 in 0.457s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.198s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "cinder-quobyte-bdc07975-d515-44a8-9c7f-db03c72dd23e-b6d32ca3-e8f3-4346-adb3-2b969e7efccd" by "_create_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a5749b-0da7-42bd-bc43-6a5709f33176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea3faa1-f832-4b58-842a-ead9b36d603c', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c629ca1-00fa-4a18-a16c-5e152b944031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:01 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Volume volume-aea3faa1-f832-4b58-842a-ead9b36d603c (aea3faa1-f832-4b58-842a-ead9b36d603c): created successfully
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c629ca1-00fa-4a18-a16c-5e152b944031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Flow 'volume_create_manager' (1280e341-c6da-4e41-a8c6-b03e6e5b3c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-quobyte-bdc07975-d515-44a8-9c7f-db03c72dd23e-b6d32ca3-e8f3-4346-adb3-2b969e7efccd" acquired by "_create_volume_from_snapshot" :: waited 0.062s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Creating volume b6d32ca3-e8f3-4346-adb3-2b969e7efccd from snapshot bdc07975-d515-44a8-9c7f-db03c72dd23e {{(pid=81538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "cinder-quobyte-b6d32ca3-e8f3-4346-adb3-2b969e7efccd" by "_copy_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:01 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-7a16c707-1b33-4a84-97e0-aa23daa0e7cf tempest-VolumeDependencyTests-1616645965 None] Created volume successfully.
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-quobyte-b6d32ca3-e8f3-4346-adb3-2b969e7efccd" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] snapshot: bdc07975-d515-44a8-9c7f-db03c72dd23e, volume: b6d32ca3-e8f3-4346-adb3-2b969e7efccd,  {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee3767b-b3d8-445f-876a-b338478cce15]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:01 devstack sudo[90552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e
Apr 27 15:18:01 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:01 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-de3fe10b-458d-4b42-b5a0-7542142c0bc1" returned: 0 in 0.477s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-quobyte-de3fe10b-458d-4b42-b5a0-7542142c0bc1" released by "delete_volume" :: held 1.087s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:01 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Created reservations ['2f6be19d-e1cb-4ae5-8d36-aa7b4b3f3340', 'e5355eb5-b2f3-406a-b8cc-14b1d679bc91', '333381dd-44e5-4cac-b041-4188caf20d90', '975b0644-1a2e-47cf-b658-a63ae432152d'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:02 devstack sudo[90556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:18:02 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:02 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e" returned: 0 in 0.541s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Creating direct copy from snapshot {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[006d9b19-cb80-4c27-8fb2-1253e9a67d10]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:02 devstack sudo[90561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd
Apr 27 15:18:02 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:02 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.472s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:18:02 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Deleted volume successfully.
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7741503d-368c-439a-9c23-9aaacc7703c5 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-de3fe10b-458d-4b42-b5a0-7542142c0bc1-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:02 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd" returned: 0 in 0.526s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.utils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Path /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd not found in is_blk_device check {{(pid=81538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:02 devstack sudo[90567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd
Apr 27 15:18:02 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Flow 'volume_create_manager' (abef26b7-4dbb-4727-8038-1b7a72048be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694cf85a-1824-4ac4-8c25-31f3271cfb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694cf85a-1824-4ac4-8c25-31f3271cfb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-680032950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e5b195-1069-4582-9ef7-372f19ec6d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb44773f6b34fa187bd8845c1fd33f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=aea3faa1-f832-4b58-842a-ead9b36d603c,status='creating',terminated_at=None,updated_at=2026-04-27T13:18:03Z,use_quota=True,user_id='9fa51d375b0a4804bc689bd9fc560dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f625fd7-c531-45fb-9db3-c0aa15f74c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f625fd7-c531-45fb-9db3-c0aa15f74c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bf798c-84a3-470c-81ef-efb0305425cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bf798c-84a3-470c-81ef-efb0305425cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a4e5b195-1069-4582-9ef7-372f19ec6d18', 'volume_name': 'volume-a4e5b195-1069-4582-9ef7-372f19ec6d18', 'volume_size': 1, 'source_volid': 'aea3faa1-f832-4b58-842a-ead9b36d603c', 'source_volstatus': 'available'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b897752-03a9-4de7-beff-4c0a6f279f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b897752-03a9-4de7-beff-4c0a6f279f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:02 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6327bb-cb3b-420e-90f7-42f3cd9842a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:03 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Volume a4e5b195-1069-4582-9ef7-372f19ec6d18: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a4e5b195-1069-4582-9ef7-372f19ec6d18', 'volume_size': 1, 'source_volid': 'aea3faa1-f832-4b58-842a-ead9b36d603c', 'source_volstatus': 'available'}
Apr 27 15:18:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "cinder-78033dd5-c300-4930-8ced-0777a4ebcf8b-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-78033dd5-c300-4930-8ced-0777a4ebcf8b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "cinder-quobyte-78033dd5-c300-4930-8ced-0777a4ebcf8b" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:03 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-quobyte-78033dd5-c300-4930-8ced-0777a4ebcf8b" acquired by "delete_volume" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:03 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a15a88-7ccc-45ad-95b3-005fe32e77dd]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-78033dd5-c300-4930-8ced-0777a4ebcf8b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:03 devstack sudo[90569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-78033dd5-c300-4930-8ced-0777a4ebcf8b
Apr 27 15:18:03 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:03 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-78033dd5-c300-4930-8ced-0777a4ebcf8b" returned: 0 in 0.832s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:03 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-78033dd5-c300-4930-8ced-0777a4ebcf8b {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:03 devstack sudo[90584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-78033dd5-c300-4930-8ced-0777a4ebcf8b
Apr 27 15:18:03 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:05 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-78033dd5-c300-4930-8ced-0777a4ebcf8b" returned: 0 in 1.074s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-quobyte-78033dd5-c300-4930-8ced-0777a4ebcf8b" released by "delete_volume" :: held 1.960s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Created reservations ['0c2112ae-301c-4e44-9040-10b285d52ded', 'e906ca10-9d58-49c8-bac5-cc9d09c369ad', '9e6ed8a0-92db-4c0d-aa4a-123ae7b05cd7', 'f5c253ee-a3c8-4011-9215-d8ca14d87e00'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "cinder-03a41595-f87c-41f3-a1c3-4e05f2906774-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:05 devstack sudo[90587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:18:05 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-03a41595-f87c-41f3-a1c3-4e05f2906774-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "cinder-quobyte-03a41595-f87c-41f3-a1c3-4e05f2906774" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-quobyte-03a41595-f87c-41f3-a1c3-4e05f2906774" acquired by "delete_volume" :: waited 0.054s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b30fb7-bcf1-445a-b80f-b2c677d590e5]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:05 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-03a41595-f87c-41f3-a1c3-4e05f2906774 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:06 devstack sudo[90589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-03a41595-f87c-41f3-a1c3-4e05f2906774
Apr 27 15:18:06 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:06 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:06 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.836s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:06 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:18:06 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Deleted volume successfully.
Apr 27 15:18:06 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-82ff6742-31d5-462b-b3ea-f7fff766f8d1 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-78033dd5-c300-4930-8ced-0777a4ebcf8b-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:07 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-03a41595-f87c-41f3-a1c3-4e05f2906774" returned: 0 in 1.355s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-03a41595-f87c-41f3-a1c3-4e05f2906774 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:07 devstack sudo[90595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-03a41595-f87c-41f3-a1c3-4e05f2906774
Apr 27 15:18:07 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:07 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:07 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-03a41595-f87c-41f3-a1c3-4e05f2906774" returned: 0 in 0.869s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:07 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-quobyte-03a41595-f87c-41f3-a1c3-4e05f2906774" released by "delete_volume" :: held 2.310s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Created reservations ['e6684b5d-c858-4982-aa97-3ca29b47c1bb', '786b74ea-f793-4b66-8e77-0f6fde6d4208', 'be864c92-d0fd-4b34-b8a9-d23b1ae2a41e', 'b4088419-8fec-40e7-8bda-29054df307e0'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:08 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd" returned: 0 in 5.270s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[117d46c7-144c-4124-9015-0e8064098c8f]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:08 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:18:08 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:08 devstack sudo[90598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd
Apr 27 15:18:08 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:08 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.447s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:18:08 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Deleted volume successfully.
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cc7cd079-73df-4058-9bd9-9f0f6902bb50 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-03a41595-f87c-41f3-a1c3-4e05f2906774-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:08 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd" returned: 0 in 0.713s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:18:08 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Converted 1024.00 MB image at 194.25 MB/s
Apr 27 15:18:08 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd is being set with open permissions: ugo+rw
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:08 devstack sudo[90607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd
Apr 27 15:18:08 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "cinder-f0146d8e-bc5d-4059-9399-44c3d96bc3b6-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-f0146d8e-bc5d-4059-9399-44c3d96bc3b6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "cinder-quobyte-f0146d8e-bc5d-4059-9399-44c3d96bc3b6" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-quobyte-f0146d8e-bc5d-4059-9399-44c3d96bc3b6" acquired by "delete_volume" :: waited 0.027s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfeed70-f37b-4111-92f0-005d760aa9f0]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:08 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:08 devstack sudo[90609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6
Apr 27 15:18:08 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:09 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd" returned: 0 in 0.478s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-quobyte-b6d32ca3-e8f3-4346-adb3-2b969e7efccd" released by "_copy_volume_from_snapshot" :: held 7.624s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-quobyte-bdc07975-d515-44a8-9c7f-db03c72dd23e-b6d32ca3-e8f3-4346-adb3-2b969e7efccd" released by "_create_volume_from_snapshot" :: held 7.673s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.737s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.986s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a768bbca7dde42fe838cf54ba9928b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:18:00Z,use_quota=True,user_id='9ce6a8a5265c42eab56499e2c00a2d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Creating volume a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:18:09 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a7f03a-b359-4e40-9769-a6956fe33edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd', 'volume_size': 1, 'snapshot_id': 'bdc07975-d515-44a8-9c7f-db03c72dd23e'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34682f36-8c79-4789-bd80-0ee171dda479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:09 devstack sudo[90612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0 1073741824
Apr 27 15:18:09 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:09 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Volume volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd (b6d32ca3-e8f3-4346-adb3-2b969e7efccd): created successfully
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34682f36-8c79-4789-bd80-0ee171dda479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Flow 'volume_create_manager' (196656fa-d7d5-42af-99da-da1174d8a85c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:18:09 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b3ad3e08-363e-46c6-91da-a9b59a7131ed tempest-SnapshotDependencyTests-774792045 None] Created volume successfully.
Apr 27 15:18:09 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6" returned: 0 in 0.558s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:09 devstack sudo[90617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6
Apr 27 15:18:09 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:09 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-f0146d8e-bc5d-4059-9399-44c3d96bc3b6" returned: 0 in 0.471s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-quobyte-f0146d8e-bc5d-4059-9399-44c3d96bc3b6" released by "delete_volume" :: held 1.075s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:09 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:09 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0 1073741824" returned: 0 in 0.685s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Created reservations ['87098cb9-fece-44f7-8f4e-adf3120fd1d0', '3a076db4-975d-4af2-a454-0bc165ea2ae0', '2f1990e9-dc0f-46c2-8b47-d8d6cba1f2c6', '8e8a10ab-8f01-43e6-8ab5-d604b2044211'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:10 devstack sudo[90623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0
Apr 27 15:18:10 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:10 devstack sudo[90625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:18:10 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "cinder-bdc07975-d515-44a8-9c7f-db03c72dd23e-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-bdc07975-d515-44a8-9c7f-db03c72dd23e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "cinder-quobyte-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-quobyte-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "cinder-quobyte-bdc07975-d515-44a8-9c7f-db03c72dd23e" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-quobyte-bdc07975-d515-44a8-9c7f-db03c72dd23e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Deleting offline snapshot bdc07975-d515-44a8-9c7f-db03c72dd23e of volume 48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] snapshot_file for this snap is: volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7eb410-12ac-456f-999e-e4d335be6aad]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:10 devstack sudo[90628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e
Apr 27 15:18:10 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:10 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.482s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:18:10 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:10 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Deleted volume successfully.
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0" returned: 0 in 0.580s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.611s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:10 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Cloning volume aea3faa1-f832-4b58-842a-ead9b36d603c to volume a4e5b195-1069-4582-9ef7-372f19ec6d18
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcbdcb67-9dd8-49df-9ccc-5f06585c267b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ded286-8c97-474a-96a1-7b1aab4f470d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:10 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Volume volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0 (a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0): created successfully
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ded286-8c97-474a-96a1-7b1aab4f470d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Flow 'volume_create_manager' (996cb2f6-2d2c-4048-884a-c9243fbd1c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a0f4126a-954d-40d8-aabe-755efc82f1bf tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-f0146d8e-bc5d-4059-9399-44c3d96bc3b6-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Creating offline snapshot 8cacf4ad-15cf-4b5d-84a4-5ca49eccd305 of volume aea3faa1-f832-4b58-842a-ead9b36d603c {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:18:10 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-f35643ca-29a3-43e3-9f0b-4da3ce918fc8 tempest-CinderUnicodeTest-1190426793 None] Created volume successfully.
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41aafa9-3aed-4d0a-829f-ff1a72c26bea]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:10 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:10 devstack sudo[90631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c
Apr 27 15:18:10 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:11 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e" returned: 0 in 0.556s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "cinder-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b4bcb7-4fcd-4742-bf2b-d992a0950b45]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "cinder-quobyte-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-quobyte-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f" acquired by "delete_volume" :: waited 0.027s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:11 devstack sudo[90636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd
Apr 27 15:18:11 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5b8daf-b9b3-4a1e-9526-c0348c7e0f0a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:11 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c" returned: 0 in 0.596s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:11 devstack sudo[90641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f
Apr 27 15:18:11 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:11 devstack sudo[90642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305 1G
Apr 27 15:18:11 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Flow 'volume_create_manager' (ad2160cf-ae98-430e-ac00-9497ce55e36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1124f9-8697-49af-9667-0ab7a832dc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1124f9-8697-49af-9667-0ab7a832dc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:18:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-777020183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a8df09-aa33-4c5d-a987-2446baafb258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a768bbca7dde42fe838cf54ba9928b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:18:12Z,use_quota=True,user_id='9ce6a8a5265c42eab56499e2c00a2d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bacd7141-fc82-41d0-a093-ddc46813c98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bacd7141-fc82-41d0-a093-ddc46813c98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b454e3-b6eb-4683-a312-fa500877ee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b454e3-b6eb-4683-a312-fa500877ee23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a8df09-aa33-4c5d-a987-2446baafb258', 'volume_name': 'volume-52a8df09-aa33-4c5d-a987-2446baafb258', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86db4b49-58f2-4827-84a0-b133de48cc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86db4b49-58f2-4827-84a0-b133de48cc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90733cb0-59d8-4cd6-a41b-d612c48e99b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:11 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Volume 52a8df09-aa33-4c5d-a987-2446baafb258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a8df09-aa33-4c5d-a987-2446baafb258', 'volume_size': 1}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:11 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd" returned: 0 in 0.666s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:11 devstack sudo[90648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e
Apr 27 15:18:11 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:11 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f" returned: 0 in 0.703s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:11 devstack sudo[90656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f
Apr 27 15:18:11 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:11 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305 1G" returned: 0 in 0.667s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:11 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea3faa1-f832-4b58-842a-ead9b36d603c -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:12 devstack sudo[90658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea3faa1-f832-4b58-842a-ead9b36d603c -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305
Apr 27 15:18:12 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:12 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e" returned: 0 in 0.572s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:12 devstack sudo[90663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e
Apr 27 15:18:12 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:12 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f" returned: 0 in 0.519s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-quobyte-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f" released by "delete_volume" :: held 1.266s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:12 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea3faa1-f832-4b58-842a-ead9b36d603c -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305" returned: 0 in 0.481s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:12 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305 is being set with open permissions: ugo+rw
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Created reservations ['c12bbec9-3791-4ae4-ac0a-4161e8a53c90', '0c26f9c3-7210-4781-8bdc-d067c0e5397b', 'c6e93be9-78a1-4d7e-a652-ac9ee70bef34', '2ffb6839-b635-41ca-8001-2a53063b2cc4'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:12 devstack sudo[90669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305
Apr 27 15:18:12 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:12 devstack sudo[90671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:18:12 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:12 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd.bdc07975-d515-44a8-9c7f-db03c72dd23e" returned: 0 in 0.475s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-quobyte-bdc07975-d515-44a8-9c7f-db03c72dd23e" released by "_delete_snapshot" :: held 2.374s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-quobyte-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd" released by "delete_snapshot" :: held 2.400s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Created reservations ['53182a0a-2bfa-417e-b484-626fa7da7cc5', '2b135899-c94d-4e82-9feb-46e567370040', 'df216cc5-d9d8-469e-a95c-22e91c840c70', '8ef06371-bdc3-4a19-a9ba-7c9a67befd48'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:12 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Delete snapshot completed successfully.
Apr 27 15:18:12 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-68c0f537-7e53-4ccf-ad94-6b2b6dd3b3c2 tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-bdc07975-d515-44a8-9c7f-db03c72dd23e-delete_snapshot" released by "delete_snapshot" :: held 2.521s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:13 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305" returned: 0 in 0.543s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:13 devstack sudo[90676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.info
Apr 27 15:18:13 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:13 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.468s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:18:13 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Deleted volume successfully.
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-30d92257-a8aa-47d6-ae23-8fb43559ee63 tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-d2ecc75f-7b2f-453c-9e97-716c1ca08a5f-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "cinder-7784ad90-14e8-47af-92b8-9a3b22fb551a-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-7784ad90-14e8-47af-92b8-9a3b22fb551a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "cinder-quobyte-7784ad90-14e8-47af-92b8-9a3b22fb551a" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-quobyte-7784ad90-14e8-47af-92b8-9a3b22fb551a" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d879ab4c-c571-4a81-a94f-d0e7c2e7c7f3]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7784ad90-14e8-47af-92b8-9a3b22fb551a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:13 devstack sudo[90679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7784ad90-14e8-47af-92b8-9a3b22fb551a
Apr 27 15:18:13 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:13 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.info" returned: 0 in 0.458s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:13 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.info is being set with open permissions: ugo+rw
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:13 devstack sudo[90681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.info
Apr 27 15:18:13 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "cinder-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "cinder-quobyte-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-quobyte-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd" acquired by "delete_volume" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[463684e4-0054-49cb-9d50-72ded5fb61c2]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:13 devstack sudo[90683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd
Apr 27 15:18:13 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:13 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.info" returned: 0 in 0.471s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-quobyte-a4e5b195-1069-4582-9ef7-372f19ec6d18" by "_copy_volume_from_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:13 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-a4e5b195-1069-4582-9ef7-372f19ec6d18" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:13 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] snapshot: 8cacf4ad-15cf-4b5d-84a4-5ca49eccd305, volume: a4e5b195-1069-4582-9ef7-372f19ec6d18,  {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7784ad90-14e8-47af-92b8-9a3b22fb551a" returned: 0 in 0.613s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7784ad90-14e8-47af-92b8-9a3b22fb551a {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cfa3c4-fd2f-4a1b-a56a-948d3c344a85]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:14 devstack sudo[90689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7784ad90-14e8-47af-92b8-9a3b22fb551a
Apr 27 15:18:14 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:14 devstack sudo[90690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305
Apr 27 15:18:14 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:14 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd" returned: 0 in 0.554s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:14 devstack sudo[90696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd
Apr 27 15:18:14 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:14 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-7784ad90-14e8-47af-92b8-9a3b22fb551a" returned: 0 in 0.441s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-quobyte-7784ad90-14e8-47af-92b8-9a3b22fb551a" released by "delete_volume" :: held 1.110s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Created reservations ['8e95a15f-5475-41b2-aba0-fdcf1ff96464', '0654f5d6-6606-4350-8ba7-afde7796aedd', 'f201ea41-dc9f-46f6-9717-5e9a0d4d45f3', 'f9dc2232-b9c0-4419-b3ca-f09306360072'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:14 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305" returned: 0 in 0.577s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aea3faa1-f832-4b58-842a-ead9b36d603c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Creating direct copy from snapshot {{(pid=81538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 27 15:18:14 devstack sudo[90702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:18:14 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5673686c-5f9e-40c8-a1a6-8ed14d03cf73]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:14 devstack sudo[90704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c
Apr 27 15:18:14 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:14 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd" returned: 0 in 0.552s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-quobyte-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd" released by "delete_volume" :: held 1.166s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Created reservations ['509d3e55-13af-429c-8482-208d1f748730', '4bd5920f-e5a9-48ae-8043-7c22dc4c5f2e', 'b2610d42-4485-41f3-9af9-45ecea9786f9', '109e8ac0-6756-4436-bccc-b69f193b6c3e'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:14 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:15 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:15 devstack sudo[90708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:18:15 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:15 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.465s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:15 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:18:15 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Deleted volume successfully.
Apr 27 15:18:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-34c4f656-d027-4bfb-a7de-9c1a87e026da tempest-CreateVolumesFromSourceVolumeTest-1937860948 None] Lock "cinder-7784ad90-14e8-47af-92b8-9a3b22fb551a-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:15 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c" returned: 0 in 0.624s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:15 devstack cinder-volume[81538]: DEBUG cinder.utils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Path /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18 not found in is_blk_device check {{(pid=81538) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 27 15:18:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:15 devstack sudo[90713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18
Apr 27 15:18:15 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:15 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:15 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.445s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:15 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:18:15 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Deleted volume successfully.
Apr 27 15:18:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-d8a8add7-74cb-40f6-b3dc-a47e7e672f2b tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-48e3ca2f-ebed-4ec8-80d1-8ace9a0daccd-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "cinder-b6d32ca3-e8f3-4346-adb3-2b969e7efccd-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:15 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-b6d32ca3-e8f3-4346-adb3-2b969e7efccd-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:16 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:UPDATE=224,cinder:SELECT=174,cinder:INSERT=63,cinder:DELETE=22 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:18:16 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "cinder-quobyte-b6d32ca3-e8f3-4346-adb3-2b969e7efccd" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:16 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-quobyte-b6d32ca3-e8f3-4346-adb3-2b969e7efccd" acquired by "delete_volume" :: waited 0.076s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:16 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c5875f-d257-4d0d-9d0a-5cc0587b063a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:16 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:16 devstack sudo[90726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd
Apr 27 15:18:16 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:17 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd" returned: 0 in 1.351s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:17 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:17 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd
Apr 27 15:18:17 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:19 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-b6d32ca3-e8f3-4346-adb3-2b969e7efccd" returned: 0 in 1.488s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:19 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-quobyte-b6d32ca3-e8f3-4346-adb3-2b969e7efccd" released by "delete_volume" :: held 2.937s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:19 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:UPDATE=248,cinder:SELECT=164,cinder:INSERT=50,cinder:DELETE=22 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:18:19 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Created reservations ['49a80efc-2acc-469e-a6cc-f884317883db', '8bae985e-6dee-4963-b209-691a70168406', '86a28584-38df-480f-8ef1-4ffd662bd233', '91682442-2e9d-4280-aee2-1e63cd04f6bc'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:19 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:19 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:19 devstack sudo[90735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:18:19 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:20 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 1.309s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:20 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:18:20 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Deleted volume successfully.
Apr 27 15:18:20 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-a3031f60-c631-4b9d-8355-ac6414adc665 tempest-SnapshotDependencyTests-774792045 None] Lock "cinder-b6d32ca3-e8f3-4346-adb3-2b969e7efccd-delete_volume" released by "delete_volume" :: held 4.870s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:20 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18" returned: 0 in 5.671s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:20 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4564a8aa-c318-4e9e-9d19-f1768c8b4268]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:20 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:21 devstack sudo[90738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c
Apr 27 15:18:21 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:21 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c" returned: 0 in 0.694s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:21 devstack cinder-volume[81538]: DEBUG cinder.image.image_utils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Image conversion details: src /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18 {{(pid=81538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 27 15:18:21 devstack cinder-volume[81538]: INFO cinder.image.image_utils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Converted 1024.00 MB image at 180.53 MB/s
Apr 27 15:18:21 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18 is being set with open permissions: ugo+rw
Apr 27 15:18:21 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:21 devstack sudo[90743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18
Apr 27 15:18:21 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:22 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18" returned: 0 in 0.494s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-a4e5b195-1069-4582-9ef7-372f19ec6d18" released by "_copy_volume_from_snapshot" :: held 8.158s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-quobyte-8cacf4ad-15cf-4b5d-84a4-5ca49eccd305" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:22 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-8cacf4ad-15cf-4b5d-84a4-5ca49eccd305" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Deleting offline snapshot 8cacf4ad-15cf-4b5d-84a4-5ca49eccd305 of volume aea3faa1-f832-4b58-842a-ead9b36d603c {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:18:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] snapshot_file for this snap is: volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:18:22 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9b4f26-4586-413a-af3e-c3ef570ca41b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:22 devstack sudo[90747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305
Apr 27 15:18:22 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:22 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305" returned: 0 in 0.588s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:22 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aea3faa1-f832-4b58-842a-ead9b36d603c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:18:22 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2b0f98-5d6b-49f0-8d34-8ff90e032fb3]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:22 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:22 devstack sudo[90752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c
Apr 27 15:18:22 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:23 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c" returned: 0 in 0.559s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:23 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:23 devstack sudo[90757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305
Apr 27 15:18:23 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:24 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305" returned: 0 in 0.627s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:24 devstack sudo[90762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305
Apr 27 15:18:24 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:24 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c.8cacf4ad-15cf-4b5d-84a4-5ca49eccd305" returned: 0 in 0.520s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-8cacf4ad-15cf-4b5d-84a4-5ca49eccd305" released by "_delete_snapshot" :: held 2.396s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.988s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.997s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f59e5a52fe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-27T13:18:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-777020183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a8df09-aa33-4c5d-a987-2446baafb258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a768bbca7dde42fe838cf54ba9928b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-27T13:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-27T13:18:12Z,use_quota=True,user_id='9ce6a8a5265c42eab56499e2c00a2d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b54d5f84-7b80-425a-b986-dea69ee9ef81),volume_type_id=b54d5f84-7b80-425a-b986-dea69ee9ef81)}" {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Creating volume 52a8df09-aa33-4c5d-a987-2446baafb258 {{(pid=81538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Selected osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c as target Quobyte volume. {{(pid=81538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 27 15:18:24 devstack cinder-volume[81538]: INFO cinder.volume.drivers.remotefs [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] casted to osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258 1073741824 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:24 devstack sudo[90766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258 1073741824
Apr 27 15:18:24 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6327bb-cb3b-420e-90f7-42f3cd9842a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e5b195-1069-4582-9ef7-372f19ec6d18', 'volume_size': 1, 'source_volid': 'aea3faa1-f832-4b58-842a-ead9b36d603c', 'source_volstatus': 'available'}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130953d1-f69b-41fc-9300-8cdc1cda87f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:24 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Volume volume-a4e5b195-1069-4582-9ef7-372f19ec6d18 (a4e5b195-1069-4582-9ef7-372f19ec6d18): created successfully
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130953d1-f69b-41fc-9300-8cdc1cda87f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:24 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Flow 'volume_create_manager' (abef26b7-4dbb-4727-8038-1b7a72048be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:18:24 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-b544d67b-b860-47ff-a923-964130c67b18 tempest-VolumeDependencyTests-1616645965 None] Created volume successfully.
Apr 27 15:18:25 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258 1073741824" returned: 0 in 0.631s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:25 devstack sudo[90771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258
Apr 27 15:18:25 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:25 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258" returned: 0 in 0.503s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'} {{(pid=81538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-aea3faa1-f832-4b58-842a-ead9b36d603c-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90733cb0-59d8-4cd6-a41b-d612c48e99b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a8df09-aa33-4c5d-a987-2446baafb258', 'volume_size': 1}' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5575768c-3259-4fe1-b76e-546610c41b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-aea3faa1-f832-4b58-842a-ead9b36d603c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:25 devstack cinder-volume[81538]: INFO cinder.volume.flows.manager.create_volume [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Volume volume-52a8df09-aa33-4c5d-a987-2446baafb258 (52a8df09-aa33-4c5d-a987-2446baafb258): created successfully
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5575768c-3259-4fe1-b76e-546610c41b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81538) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Flow 'volume_create_manager' (ad2160cf-ae98-430e-ac00-9497ce55e36e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81538) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 27 15:18:25 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-8dd28cd7-7c2d-49c0-b37d-bc3515765f77 tempest-CinderUnicodeTest-1190426793 None] Created volume successfully.
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-quobyte-aea3faa1-f832-4b58-842a-ead9b36d603c" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-aea3faa1-f832-4b58-842a-ead9b36d603c" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[466e06f2-2417-4368-b133-b4aa4293f393]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:25 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:26 devstack sudo[90775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c
Apr 27 15:18:26 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:26 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c" returned: 0 in 0.576s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:26 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:26 devstack sudo[90780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c
Apr 27 15:18:26 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:27 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-aea3faa1-f832-4b58-842a-ead9b36d603c" returned: 0 in 0.585s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] Creating offline snapshot da5fd378-2e3d-4be6-a37b-c5c326fa20f5 of volume 52a8df09-aa33-4c5d-a987-2446baafb258 {{(pid=81538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-aea3faa1-f832-4b58-842a-ead9b36d603c" released by "delete_volume" :: held 1.237s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a20389c-686b-492b-a376-7fd384221316]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Created reservations ['5cff1a3a-773e-4298-9405-24404acb3724', 'f0bbf84f-b4d5-4643-8bf8-2e0784b07254', '25bf9a8e-f72e-4e60-b168-b4db3c4cbef5', '32d80a9e-4282-42b8-8268-66491012d2c9'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:27 devstack sudo[90783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258
Apr 27 15:18:27 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:27 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:18:27 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:27 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258" returned: 0 in 0.622s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5 1G {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:27 devstack sudo[90792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5 1G
Apr 27 15:18:27 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:27 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.530s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:18:27 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Deleted volume successfully.
Apr 27 15:18:27 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-32674935-980b-42aa-bdce-93e761382ff5 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-aea3faa1-f832-4b58-842a-ead9b36d603c-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:28 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-a4e5b195-1069-4582-9ef7-372f19ec6d18-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:28 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-a4e5b195-1069-4582-9ef7-372f19ec6d18-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:28 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-quobyte-a4e5b195-1069-4582-9ef7-372f19ec6d18" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:28 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-a4e5b195-1069-4582-9ef7-372f19ec6d18" acquired by "delete_volume" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:28 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bdaf6c-0212-44fe-9ef5-f241b8ee812b]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:28 devstack sudo[90794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18
Apr 27 15:18:28 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:28 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5 1G" returned: 0 in 0.734s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52a8df09-aa33-4c5d-a987-2446baafb258 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:28 devstack sudo[90800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52a8df09-aa33-4c5d-a987-2446baafb258 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5
Apr 27 15:18:28 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:28 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18" returned: 0 in 0.644s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:28 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:28 devstack sudo[90805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18
Apr 27 15:18:28 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:29 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52a8df09-aa33-4c5d-a987-2446baafb258 -F qcow2 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5" returned: 0 in 0.594s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:29 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5 is being set with open permissions: ugo+rw
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:29 devstack sudo[90810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5
Apr 27 15:18:29 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:29 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a4e5b195-1069-4582-9ef7-372f19ec6d18" returned: 0 in 0.496s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-a4e5b195-1069-4582-9ef7-372f19ec6d18" released by "delete_volume" :: held 1.192s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Created reservations ['25c744ff-af41-4f0e-9fb7-53ba0d146225', '92675fbf-e8a2-41da-b055-ff8d2dfece52', '7027a8f5-6852-4328-9115-f1dec6311843', '8f97d611-889f-440f-aa5e-a46cc9ba7950'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:29 devstack sudo[90813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:18:29 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:29 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5" returned: 0 in 0.482s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:29 devstack sudo[90816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.info
Apr 27 15:18:29 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:29 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.458s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:18:29 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Deleted volume successfully.
Apr 27 15:18:29 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-e53b669f-561c-42f5-bf41-9043d5bb6324 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-a4e5b195-1069-4582-9ef7-372f19ec6d18-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:30 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.info" returned: 0 in 0.471s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:30 devstack cinder-volume[81538]: WARNING cinder.volume.drivers.remotefs [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.info is being set with open permissions: ugo+rw
Apr 27 15:18:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.info {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:30 devstack sudo[90820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.info
Apr 27 15:18:30 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "cinder-quobyte-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:30 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3" acquired by "delete_volume" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:30 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8423a11d-af8c-4443-ad89-d68915303deb]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:30 devstack sudo[90823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3
Apr 27 15:18:30 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:30 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.info" returned: 0 in 0.471s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:30 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.495s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:30 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-5d564cd0-6645-4f8f-a922-f64c48a09f95 tempest-CinderUnicodeTest-1190426793 None] Create snapshot completed successfully
Apr 27 15:18:31 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3" returned: 0 in 0.510s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:31 devstack sudo[90828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3
Apr 27 15:18:31 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Acquiring lock "cinder-da5fd378-2e3d-4be6-a37b-c5c326fa20f5-delete_snapshot" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Lock "cinder-da5fd378-2e3d-4be6-a37b-c5c326fa20f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Acquiring lock "cinder-quobyte-52a8df09-aa33-4c5d-a987-2446baafb258" by "delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Lock "cinder-quobyte-52a8df09-aa33-4c5d-a987-2446baafb258" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Acquiring lock "cinder-quobyte-da5fd378-2e3d-4be6-a37b-c5c326fa20f5" by "_delete_snapshot" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Lock "cinder-quobyte-da5fd378-2e3d-4be6-a37b-c5c326fa20f5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Deleting offline snapshot da5fd378-2e3d-4be6-a37b-c5c326fa20f5 of volume 52a8df09-aa33-4c5d-a987-2446baafb258 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] snapshot_file for this snap is: volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5 {{(pid=81538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d617c76-1c0a-4687-b3cc-1e00be5043e0]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:31 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3" returned: 0 in 0.463s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-quobyte-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3" released by "delete_volume" :: held 1.016s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:31 devstack sudo[90831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5
Apr 27 15:18:31 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Created reservations ['bf22b5e7-5177-4d21-87e9-d0799eecf76f', 'b84fb26c-10a5-4f0f-817c-78cefeaca71f', 'e6c0a00a-6618-4ed9-9675-0dc6e025ed34', '36d23a00-4c59-4366-bd10-8b4aedb9be09'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:31 devstack sudo[90833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:18:31 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:31 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5" returned: 0 in 0.550s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:31 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.remotefs [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52a8df09-aa33-4c5d-a987-2446baafb258(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 27 15:18:32 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd3e471-9f9b-4e9d-b5d6-005d21cc4c6a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:32 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.441s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:32 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:18:32 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Deleted volume successfully.
Apr 27 15:18:32 devstack sudo[90839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258
Apr 27 15:18:32 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-cb01bf6b-a021-470e-b4b2-f6356f0425e4 tempest-VolumeDependencyTests-1616645965 None] Lock "cinder-dd2a15b0-4090-47c5-828c-0bbcc5b6fce3-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:32 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:32 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258" returned: 0 in 0.530s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:32 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:32 devstack sudo[90844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5
Apr 27 15:18:32 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:33 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5" returned: 0 in 0.564s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:33 devstack sudo[90849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5
Apr 27 15:18:33 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:33 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:33 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258.da5fd378-2e3d-4be6-a37b-c5c326fa20f5" returned: 0 in 0.500s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:33 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Lock "cinder-quobyte-da5fd378-2e3d-4be6-a37b-c5c326fa20f5" released by "_delete_snapshot" :: held 2.250s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:33 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Lock "cinder-quobyte-52a8df09-aa33-4c5d-a987-2446baafb258" released by "delete_snapshot" :: held 2.279s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:33 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Created reservations ['3b2e3423-14e5-4c3b-a507-dd2075676954', 'b236a7bf-80f8-41a7-a932-6a33c2e1907a', '10223f78-e7c9-4c2c-93d6-dd5738060cce', '35f9d92b-92a4-499e-9c97-4b94314b34fd'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:33 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Delete snapshot completed successfully.
Apr 27 15:18:33 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-20e8a6df-a534-44f8-9afb-b3f6bb314e06 tempest-CinderUnicodeTest-1190426793 None] Lock "cinder-da5fd378-2e3d-4be6-a37b-c5c326fa20f5-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:34 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Acquiring lock "cinder-52a8df09-aa33-4c5d-a987-2446baafb258-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:34 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Lock "cinder-52a8df09-aa33-4c5d-a987-2446baafb258-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:34 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Acquiring lock "cinder-quobyte-52a8df09-aa33-4c5d-a987-2446baafb258" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:34 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Lock "cinder-quobyte-52a8df09-aa33-4c5d-a987-2446baafb258" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:34 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[954d7e54-4666-43e4-8dea-605827561c9a]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:34 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:34 devstack sudo[90858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258
Apr 27 15:18:34 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:35 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258" returned: 0 in 0.502s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:35 devstack sudo[90863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258
Apr 27 15:18:35 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:35 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-52a8df09-aa33-4c5d-a987-2446baafb258" returned: 0 in 0.435s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:35 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Lock "cinder-quobyte-52a8df09-aa33-4c5d-a987-2446baafb258" released by "delete_volume" :: held 1.006s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:35 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Created reservations ['71395696-8f33-4d85-a1db-c6b53c5cd9d9', '71dfc2c2-14c5-4cca-b940-947bf986b00b', '1924c06d-2fd0-44ef-beb8-6119f5b4eb32', '92913cd7-f4ec-43ea-be28-20c4d0dcdecd'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:35 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:35 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:35 devstack sudo[90866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:18:35 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:36 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.413s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:36 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:18:36 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Deleted volume successfully.
Apr 27 15:18:36 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-2ecbd860-543c-47be-96a7-6bf78edff699 tempest-CinderUnicodeTest-1190426793 None] Lock "cinder-52a8df09-aa33-4c5d-a987-2446baafb258-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:36 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Acquiring lock "cinder-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0-delete_volume" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:36 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Lock "cinder-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:36 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Acquiring lock "cinder-quobyte-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0" by "delete_volume" {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 27 15:18:36 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Lock "cinder-quobyte-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0" acquired by "delete_volume" :: waited 0.015s {{(pid=81538) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 27 15:18:36 devstack cinder-volume[81538]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8b63d8-01dc-4474-8eca-70a6873ed0aa]: (4, 'qcow2') {{(pid=82488) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 27 15:18:36 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:36 devstack sudo[90869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0
Apr 27 15:18:36 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:37 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0" returned: 0 in 0.504s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:37 devstack sudo[90874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0
Apr 27 15:18:37 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:37 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910/volume-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0" returned: 0 in 0.432s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:37 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Lock "cinder-quobyte-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0" released by "delete_volume" :: held 0.975s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:37 devstack cinder-volume[81538]: DEBUG cinder.quota [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Created reservations ['55892eef-3d41-4c65-81b5-7f59a0d70b42', 'e8feeba2-12ef-4ce7-ac8b-18a791b99b68', 'de9b380c-c6d0-4cc0-98c4-2cd5f510d742', '7065a871-eb0a-4ed5-8b9a-5ddcdcf5cd50'] {{(pid=81538) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 27 15:18:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:37 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:37 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:37 devstack sudo[90877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:18:37 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:38 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:38 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.422s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:38 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 27 15:18:38 devstack cinder-volume[81538]: INFO cinder.volume.manager [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Deleted volume successfully.
Apr 27 15:18:38 devstack cinder-volume[81538]: DEBUG cinder.coordination [None req-7a8790e9-7a91-4c77-8eaa-735bbc85bc12 tempest-CinderUnicodeTest-1190426793 None] Lock "cinder-a8c7e2a2-a4d3-4d0f-9662-3b310aaafca0-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=81538) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 27 15:18:47 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=38,cinder:INSERT=18,cinder:UPDATE=56,cinder:DELETE=3 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:18:48 devstack cinder-volume[81538]: DEBUG dbcounter [-] [81538] Writing DB stats cinder:SELECT=41,cinder:UPDATE=65,cinder:DELETE=6,cinder:INSERT=13 {{(pid=81538) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 27 15:18:48 devstack cinder-volume[81538]: DEBUG oslo_service.periodic_task [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81538) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 27 15:18:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 27 15:18:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 27 15:18:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c': None} {{(pid=81538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 27 15:18:48 devstack cinder-volume[81538]: DEBUG cinder.volume.drivers.quobyte [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-529b92a6-2044-42a4-b041-d54ec766338c'] {{(pid=81538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 27 15:18:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.lockutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81538) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 27 15:18:48 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910 {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 27 15:18:48 devstack sudo[90886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910
Apr 27 15:18:48 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 27 15:18:49 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root
Apr 27 15:18:49 devstack cinder-volume[81538]: DEBUG oslo_concurrency.processutils [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bd2372b30d7c86eff640e8121fab3910" returned: 0 in 0.422s {{(pid=81538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 27 15:18:49 devstack cinder-volume[81538]: DEBUG cinder.manager [None req-b8b42d37-f74e-4b42-b388-e585513822cd None None] Notifying Schedulers of capabilities ... {{(pid=81538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}